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ABSTRACT 


This  thesis  documents  the  findings  of  the  Naval  Postgraduate  School  (NPS) 
research  team’s  efforts  on  the  initial  phase  of  the  Iraqi  Enrollment  via  Voice 
Authentication  Project  (IEVAP).  The  IEVAP  is  an  Office  of  the  Secretary  of  Defense 
(OSD)  sponsored  research  project  commissioned  to  study  the  feasibility  of  speaker 
verification  technology  in  support  of  the  Global  War  on  Terrorism  security  requirements. 
The  intent  of  this  project  is  to  contribute  toward  the  future  employment  of  speech 
technologies  in  a  variety  of  coalition  military  operations  by  developing  a  pilot  proof-of- 
concept  system  that  integrates  speaker  verification  and  automated  speech  recognition 
technology  into  a  mobile  platform  to  enhance  warfighting  capabilities. 

In  this  first  phase  of  the  IEVAP,  NPS  developed  with  the  assistance  of  Nuance 
Communications,  Inc.  and  the  Defense  Language  Institute,  a  bilingual  (English  and 
Jordanian-Arabic)  speech  application  that  demonstrates  the  viability  of  speaker 
verification  technology  for  use  in  operations  in  Iraq.  Additionally,  NPS  conducted  a  test 
to  assess  the  accuracy  claim  of  Nuance's  packaged  speaker  verification  application, 
Nuance  Caller  Authentication  1.0  (for  North  American  English).  The  NPS  test  consisted 
of  68  speaker  enrollments  and  411  speaker  verification  attempts.  Upon  completion  of  the 
test,  NPS  conducted  a  single  data-point  analysis  yielding  a  system  accuracy  of  95.87%. 
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I. 


INTRODUCTION 


A.  OVERVIEW 

This  master  thesis  documents  the  findings  of  the  initial  phase  of  the  Iraqi 
Enrollment  via  Voice  Authentication  Project  (IEVAP).  The  IEVAP  is  an  Office  of  the 
Secretary  of  Defense  (OSD)  sponsored  research  project  that  studies  the  feasibility  of 
speaker  verification  and  speech  recognition  technology  in  support  of  the  Global  War  on 
Terrorism  (GWOT)  security  requirements. 

Currently,  there  is  no  consistent  method  of  personal  identification  for  the  Iraqi 
populace.  This  lack  of  consistent  identification  contributes  to  an  overall  lack  of  security 
and  impacts  stabilization  efforts  by  the  sovereign  Iraqi  Government  and  Coalition  forces. 
An  urgent  need  exists  for  a  means  to  accurately  identify  individuals  who  require  access 
through  controlled  entry  points  to  secure  areas.  The  IEVAP  responds  to  this  need  by 
drawing  on  a  key  biometric  technology-speaker  verification-and  coupling  it  with 
identification  data  to  enhance  force  protection  and  to  control  entry  into  secure  points 
within  the  country  [1], 

The  intent  of  the  IEVAP  is  to  contribute  toward  the  future  employment  of  speech 
technologies  in  a  variety  of  coalition  military  operations  by  developing  a  pilot  proof-of- 
concept  (POC)  system  that  integrates  commercial-off-the-shelf  (COTS)  speaker 
verification  and  automated  speech  recognition  (ASR)  technologies  into  a  mobile  platform 
to  enhance  warfighting  capability. 

It  is  envisioned  that  when  used  in  conjunction  with  other  biometric  systems  and 
security  procedures,  speaker  verification  applications  can  become  a  primary  tool  in 
positively  identifying  individuals  and  in  controlling  access  to  secure  areas.  Once  the 
POC  has  been  established,  additional  applications  using  speaker  verification  and  ASR 
technologies  may  be  developed  to  enable  the  delivery  of  additional  services.  Moreover, 
IEVAP  is  an  initiative  that  transcends  the  potential  implementation  in  Iraq.  A  successful 
POC  could  lead  to  applications  in  other  stabilization  and  reconstruction  efforts  elsewhere, 
such  as  in  Afghanistan. 
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B.  BACKGROUND 


The  Naval  Postgraduate  School  (NPS)  has  been  tasked  by  the  OSD  with 
developing  and  demonstrating  a  pilot  POC  system  in  support  of  the  IEVAP.  The  IEVAP 
is  organized  into  several  project  phases  that  are  intended  to  take  the  POC  system  from 
concept  development  to  operational  testing  in  Iraq.  This  thesis  documents  the  findings  of 
the  first  two  sub-phases  (Phase  1A  and  Phase  IB)  within  Phase  1  of  this  project,  which 
are  as  follows: 

•  Phase  1.  Pilot  menu-driven  laptop  system  and  demonstration  that  voice 
authentication  technology  can  work  with  sufficient  accuracy. 

•  Phase  1A.  Develop  and  demonstrate  a  bilingual  voice-activated 
menu-driven  phone  system  in  English  and  Arabic. 

•  Phase  IB.  Test  and  demonstrate  speaker  verification  technology 
in  English. 

•  Phase  1C.  Test  and  demonstrate  speaker  verification  technology 
in  Iraqi- Arabic. 

•  Phase  2.  Detailed  development  of  enrollment  applications 

•  Phase  3.  Preparation  of  systems/applications  for  deployment 

•  Phase  4.  Deployment 

•  Phase  5.  Operational  testing  in  Iraq 

•  Phase  6.  Broader  deployment  decision 

C.  RESEARCH  QUESTIONS 

•  Is  it  possible  to  create  and  deploy  a  mobile  speaker  verification  platform 
using  existing  COTS  technologies  to  assist  in  operations  in  support  of  the 
GWOT  security  requirements? 

•  What  COTS  applications  are  currently  available  to  perform  speaker 
verification  capabilities? 
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•  What  are  the  performance  measures  of  a  speaker  verification  system? 

•  What  are  the  strengths  and  limitations  of  existing  COTS  speaker 
verification  technology? 

D.  SCOPE  OF  THESIS 

This  thesis  focuses  on  the  technologies  addressed  in  support  of  Phase  1A  and  IB 
of  the  IEVAP,  which  includes  the  development  and  demonstration  of  a  bilingual  (English 
and  Jordanian-Arabic)  voice-activated  menu-driven  telephone  system  and  an  analysis  of 
results  of  the  NPS  Speaker  Verification  Test.  The  value  of  this  research  includes: 

•  Demonstrating  the  viability  of  speaker  verification  and  ASR  technology 
for  subsequent  research,  development,  and  possible  real-world 
implementation. 

•  Providing  a  “quick  response”  research  and  development  capability  to 
address  external  customer  requirements. 

•  Selecting  the  most  appropriate  hardware,  software,  and  peripherals  for  a 
mobile  demonstration  kit  (laptop,  voice  input  devices,  etc)  for 
implementing  speaker  verification  and  ASR  technologies. 

E.  RESEARCH  METHODOLOGY 

This  research  uses  the  quantitative  approach  for  data  collection  and  analysis.  This 
research  consists  of  the  development  of  a  bilingual  (English  and  Jordanian-Arabic) 
application  to  assist  in  detainee  visitation  at  the  Baghdad  Central  Correction  Facility 
(BCCF),  formerly  known  as  the  Abu  Ghraib  Detention  Facility.  This  research  also 
consists  of  an  analysis  of  the  COTS  speaker  verification  software,  Nuance  Caller 
Authentication  (NCA)  1.0  (for  North  American  English).  Additionally,  a  literature 
review  consisting  of  various  studies,  reports,  and  other  documentation  related  to  the  field 
of  speaker  verification  technology  is  also  presented. 
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F.  THESIS  ORGANIZATION 

Chapter  II  introduces  speaker  verification  technology.  Chapter  III  provides  an 
overview  of  Nuance  Communication,  Inc.  and  its  core  technologies,  operating  platform 
and  packaged  applications.  Chapter  IV  describes  the  development  of  the  bilingual 
(English  and  Jordanian-Arabic)  voice-activated  menu-driven  phone  system  application, 
including  the  identification  of  the  equipment  (hardware,  software,  and  peripherals)  used 
to  develop  and  demonstrate  the  pilot  POC  system  and  the  design  methodology  and 
application  features  of  the  bilingual  voice-activated  menu-driven  system.  Chapter  V 
describes  a  test  to  assess  the  performance  of  the  NCA  speaker  verification  application 
using  the  Nuance's  North  American  English  language  verification  master  package 
(language  module),  to  include  the  identification  of  equipment  (hardware,  software  and 
peripherals)  used  to  conduct  this  test  and  an  analysis  of  the  results  of  the  NPS  Speaker 
Verification  Test.  Finally,  Chapter  VI  concludes  with  recommendations  for  future  work. 
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II.  SPEAKER  VERIFICATION  TECHNOLOGY 


A.  OVERVIEW 


Speaker  verification  also  known  as  voice  authentication  or  voice  verification  is 
not  a  new  technology.1  Dating  back  to  the  1960s,  considerable  research  in  this  field  has 
occurred  in  academia  and  the  commercial  sectors  [2]  [3].  And  with  the  exponential 
growth  in  technological  advances  in  computational  processing  power  and  in 
communication,  speaker  verification  has  become  a  viable  form  of  biometric  technology. 


In  the  taxonomy  of  Speech  and  Language  Processing  (see  Figure  1),  Speaker 
Verification  falls  under  the  classification  of  Speaker  Recognition  with  the  goal  to  extract, 
characterize  and  recognize  the  information  in  the  speech  signal  conveying  speaker 
identity  [3].  Within  speaker  recognition,  there  are  two  fundamental  tasks,  which  are 
often  mistaken  for  one  another,  speaker  identification  and  speaker  verification. 


Speech  &  Language  Processing  Taxonomy 


I^^Anajy&s/^^thesi^^Jj 


j^Tex^rocessinj^^ 


Figure  1.  Speech  and  Language  Process  Taxonomy  [After  Ref.  4] 

1  Though  the  terms  verification  and  authentication  are  generally  used  interchangeably,  there  is  a  subtle  difference 
in  the  actual  interpretation  of  these  terms.  Verification  refers  to  the  process  of  comparing  (matching)  a  presented  voice 
sample  against  another  voice  sample  in  the  system  with  a  previously  claimed  identity.  Authentication  refers  to  a 
process  similar  to  verification  with  the  additional  constraint  of  an  independent  means,  such  as,  a  personal  identification 
number  (PIN)  or  a  fingeiprint  biometric  to  validate  the  identity  of  the  claimant  other  than  voice  verification  alone. 
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The  first  task,  speaker  identification,  is  the  task  of  determining  who  is  talking 
from  a  set  of  known  voices  or  speakers.  In  speaker  identification,  the  unknown  person 
makes  no  identity  claim,  so  the  system  must  perform  a  1:N  classification.  The  second 
task,  speaker  verification,  is  the  task  of  determining  whether  a  person  is  who  he  or  she 
claims  to  be.  In  speaker  verification  applications,  the  system  validates  a  person's  identify 
by  comparing  the  captured  voice  biometric  data  with  his  or  her  stored  voice  biometric 
data,  which  is  to  say  that  a  system  performs  a  1:1  classification  [3]. 

Most  commercial  applications  today  fall  in  the  category  of  speaker  verification 
vice  speaker  identification.  The  main  reason  is  because  it  is  far  easier  and  quicker  (and 
vastly  more  accurate)  to  determine  a  1:1  classification  than  1:N  classification.  However, 
this  does  not  mean  that  advances  have  not  been  achieved  in  speaker  identification 
technology.  Today,  there  is  a  great  deal  of  research  in  the  advancement  of  speaker 
recognition  technologies,  such  as,  improving  the  performance  of  speaker  recognition 
systems  using  high-level  information  [5],  developing  recognition  techniques  for  multi¬ 
speaker  environments  [6],  developing  and  evaluating  corpora  for  speech  processing 
systems  [7],  and  developing  and  testing  of  multi-modal  biometric  systems,  e.g.,  fusion  of 
fingerprint  and  speaker  verification  systems  [8].  For  additional  information  regarding  the 
topic  of  speaker  recognition  refer  to  references  [2],  [3],  [9],  [10]  and  [11]. 

B.  SPEAKER  VERIFICATION  PROCESS 

The  basic  structure  for  a  speaker  verification  system  is  shown  in  Figure  2.  A 

speaker  verification  system  has  two  distinct  phases,  the  first  is  the  enrollment  phrase  and 

the  second  is  the  verification  phase.  In  the  enrollment  phrase,  the  speech  signal  is  first 

processed  to  extract  features  conveying  speaker  information,  and  then  a  voice  model  is 

created  based  on  the  collected  data  from  the  speech  signal,  which  is  then  stored  in  a 

database  for  later  reference  during  the  verification  phase.  In  the  verification  phase,  the 

speech  signal  is  again  processed  to  extract  features  conveying  speaker  information; 

however,  this  time  instead  of  creating  a  voice  model,  the  speaker  verification  system 

implements  a  likelihood  ratio  test  to  distinguish  between  two  hypotheses  to  determine  if 

the  speech  sample  comes  from  the  claimed  speaker  or  from  an  imposter.  Features 

extracted  from  the  speech  signal  are  compared  to  a  model  representing  the  claimed 
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speaker  (obtained  from  a  previous  enrollment)  and  to  some  background  or  composite 
model  representing  potential  imposter  speakers.  The  ratio  of  the  speaker  and  the  imposter 
match  scores  is  the  likelihood  ratio  statistic,  which  is  then  compared  to  a  set  threshold  to 
decide  whether  to  accept  or  reject  the  speaker  [12]. 


Speaker  Verification  Process 


Figure  2.  Speaker  Verification  Process  [After  Ref.  13] 

C.  PERFORMANCE  MEASURES 

Performance  of  a  speaker  verification  system  is  based  on  the  measure  between 
two  types  of  errors  found  in  biometrics  system.  The  two  types  of  errors  that  can  occur  in 
biometrics  systems  are  False  Match  Rate  (FMR)  and  False  Non-Match  Rate  (FNMR), 
more  commonly  referred  as  False  Accept  Rate  (FAR)  and  False  Reject  Rate  (FRR)  [10]. 

•  False  Accept  is  the  false  acceptance  of  an  invalid  user,  such  as  in  the  case 
of  an  impostor  breaking  into  a  system  (also  known  as  a  Type-I  error). 

•  False  Reject  is  the  false  rejection  of  a  valid  user,  such  as  in  the  case  of 
rejecting  a  true  speaker  (also  known  as  a  Type-II  error). 
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The  tradeoff  between  FAR  and  FRR  exists  in  every  biometric  system.  For 
instance,  if  a  system's  threshold  is  set  to  allow  for  greater  user  convenience,  the 
probability  of  false  rejections  (FRR)  decreases,  and  the  likelihood  that  an  imposter  can 
break  into  the  system  (FAR)  increases.  Likewise,  the  opposite  would  hold  true,  if  a 
system's  threshold  is  set  to  allow  for  greater  user  security,  the  probability  of  false 
rejections  increases  (FRR  rises)  while  the  likelihood  that  an  imposter  breaks  into  the 
system  decreases  (FAR  diminishes).  System  performance  at  all  the  operating  points 
(thresholds)  can  be  depicted  in  the  form  of  a  receiver  operating  characteristic  (ROC) 

9 

curve.  A  ROC  Curve  is  a  plot  of  FAR  against  FRR  for  various  threshold  values  for  a 
given  application.  An  example  of  an  ROC  Curve  is  shown  in  Figure  3,  in  which  the 
desired  area  for  a  given  application  is  at  the  lower  left  of  the  plot,  where  both  types  of 
errors  are  minimized. 


Receiver  Operation  Characteristics  (ROC)  Curve 


Figure  3.  Receiver  Operating  Characteristics  (ROC)  Curve 


-  Fukunaga,  K.,  Introduction  to  Statistical  Pattern  Recognition,  Academic  Press,  1990.  ROC  curve  analysis  was 
developed  in  the  early  1950’s  during  World  War  II  to  detect  weak  radio  signals  in  noise.  Since  then  it  has  become  the 
de  facto  standard  statistical  tool  for  quantifying  and  measuring  system  performance. 
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In  Figure  3,  the  point  where  the  FRR  and  FAR  are  equal  is  called  the  equal  error 
rate  (EER).  Often  the  EER  is  used  as  the  single  summary  number  to  gauge  the 
performance  of  a  speaker  verification  application  [14].  The  green  line  shown  in  Figure  3 
represents  the  various  pairs  of  (FAR,  FRR)  values  corresponding  to  a  possible  set  of 
thresholds  to  which  a  given  application  can  be  set.  For  instance,  in  applications  that 
required  greater  security,  one  would  set  the  threshold  of  an  application  to  the  left  of  the 
ERR  along  the  green  curve,  reflecting  a  lower  probability  of  false  accept  but  at  the  same 
time  accepting  a  higher  probability  of  false  reject. 

More  recently,  a  variant  of  an  ROC  curve,  called  the  detection  error  tradeoff 
(DET)  curve  has  been  employed,  especially  in  the  academic  and  national  research 
institutions.  The  DET  curve  plots  the  same  tradeoff  shown  in  a  ROC  curve  using  a 
normal  deviate  scale  [12].  This  has  the  effect  of  moving  the  curves  away  from  the  lower 
left  corner  when  performance  is  high  and  producing  linear  curves.  The  advantage  of  a 
DET  curve  over  a  ROC  curve  is  that  it  allows  easier  comparisons  of  multiple  data  sets. 
Figure  4  shows  the  comparison  of  a  data  set  plotted  on  two  different  curves,  the  DET 
Curve  and  the  ROC  Curve.  For  additional  information  on  the  ROC  analysis  and 
hypothesis  testing  principles  note  references  [9],  [10]  and  [15]. 


Figure  4.  ROC  Curve  and  DET  Curve  [From  Ref.  14] 
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D.  SYSTEM  ACCURACY 


Within  the  context  of  speaker  verification  technology,  system  accuracy  is 
dependent  on  numerous  factors,  such  as  the  level  of  user  cooperation  and  the  type  of 
system  constraints  levied  on  a  given  application.  In  speaker  verification  applications, 
speech  used  for  system  enrollment  and  verification  can  span  from  text-dependent  to  text- 
independent,  resulting  in  different  levels  of  system  performance.  In  a  text-dependent 
application,  a  speaker  states  the  same  text  during  enrollment  and  verification  and  the 
speaker-verification  system  has  prior  knowledge  of  this  text.  Whereas  in  a  text- 
independent  application,  the  system  has  no  prior  knowledge  of  the  text  to  be  spoken, 
which  makes  it  more  complex  for  the  system  to  process  [12].  Figure  5  depicts  a  DET 
curve  with  a  different  level  of  constraints  for  four  speaker  verification  experiments.  The 
data  represented  in  Figure  5  are  based  on  verification  experiments  conducted  by 
Reynolds,  D.A.  [12].  With  each  level  of  constraints,  ranging  from  category  4  (text- 
independent  using  read  sentences)  to  category  1  (text-dependent  using  combination  lock 
phrases)  the  level  of  system  performance  increases;  however,  a  caveat  to  increasing  the 
level  of  constraints  on  a  system  is  that  the  system  becomes  less  user  friendly. 


Legend: 

1 .  Text-dependent  using  combinations  lock 
phrases,  e.g.,  35-41-89. 

(Accuracy  Rate:  99.9%  -  99%) 

2.  Text-dependent  using  1 0  digit  strings. 

(Accuracy  Rate:  99%  -  95%) 

3.  Text-independent  using  conversational 
speech. 

(Accuracy  Rate:  93%  -  85%) 

4.  Text-independent  using  read  sentences. 

(Accuracy  Rate:  80%  -  65%) 


O.l  0.2  O.S  1  2  €  10  20  40 

_ Probability  of  False  Accept  (in  %) _ 


Detection  Error  Tradeoff  Plot 


Figure  5.  DET  Curve  Accuracy  Constraints  [After  Ref.  12] 
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E.  COMPARISON  OF  VARIOUS  BIOMETRICS 


How  does  speaker  verification  compare  to  other  forms  of  biometrics?  A  number 
of  biometric  characteristics  exist  and  are  used  in  various  applications.  Each  biometric  has 
its  strengths  and  weaknesses  and  the  choice  depends  on  the  application.  No  single 
biometric  is  expected  to  meet  the  requirements  of  all  the  applications  effectively.  The 
match  between  a  specific  biometric  and  an  application  is  determined  depending  upon  the 
perceived  user  profiles,  the  need  to  interface  with  other  systems  or  databases, 
environmental  conditions,  cost,  and  the  properties  of  the  biometric  characteristic  [15]. 
Table  1  presents  a  comparison  of  the  leading  forms  of  biometric  system. 


Comparison  of  Biometrics 

Characteristics 

Fingerprint 

Hand 

Retina 

Iris 

Face 

Signature 

Voice 

Ease  of  Use 

High 

High 

Low 

Medium 

Medium 

High 

High 

Error  Incidence 

Dryness,  dirt, 
age 

Hand  injury, 
age 

Glasses 

Poor  lighting 

Lighting,  age, 
glasses,  hair 

Changing 

Signatures 

Noise,  colds, 
channel 

variables 

Accuracy 

High 

High 

Very  high 

Very  high 

High 

High 

High 

User  Acceptance 

Medium 

Medium 

Medium 

Medium 

Medium 

Very  high 

High 

Required  Security 
Level 

High 

Medium 

High 

Very  high 

Medium 

Medium 

Medium 

Long  Term  Stability 

High 

Medium 

High 

High 

Medium 

Medium 

Medium 

Table  1.  Comparison  of  Biometrics  [After  Ref.  16] 


In  addition  to  the  characteristics  compared  in  Table  1,  there  are  other 
characteristics  that  favor  the  use  of  voice  biometrics,  which  are  remote-ability,  flexibility, 
maintenance  and  cost.  In  terms  of  perceived  applications  for  operations  in  Iraq,  these 
characteristics  are  unmatched  when  contrasted  to  other  forms  of  biometrics. 

First,  voice  biometrics  uses  existing  telecommunication  infrastructures  (landline, 
cellular  or  Voice  over  Internet  Protocol  [VoIP]),  as  such,  a  new  infrastructure  is  not 
required  to  be  built  around  the  deployment/employment  of  this  technology,  which 
reduces  costs  and  deploys  technology  rapidly.  Second,  voice  biometrics  allows 
dissemination  and  collection  of  information  other  than  key  biometric  data,  such  as,  the 
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collection  of  names,  addresses,  and  telephone  numbers  of  high-target  individuals.  Third, 
voice  biometrics  can  be  employed  in  multilingual  applications  without  the  aid  of  a  trained 
linguist  or  a  translator,  which  results  in  manpower  savings.  And  fourth,  voice  biometrics 
rely  on  a  signal  that  is  natural  and  unobtrusive  to  produce  and  is  easily  obtainable  with  no 
special  user  equipment  or  training,  which  results  in  the  rapid  deployment  of  technology 
without  adding  additional  training  requirements  for  troops  serving  in  Iraq  and  Iraqi 
citizens. 

However,  as  with  any  given  biometric  system,  there  are  limitations  in  addition  to 
its  strengths.  First,  speech  is  a  behavioral  signal  that  may  not  be  consistently  reproduced 
by  a  speaker  and  can  be  affected  by  a  speaker's  health,  emotions,  and  age.  Second,  voice 
biometrics  is  dependent  on  the  communication  infrastructure;  therefore,  if  the 
transmission  quality  of  the  communication  infrastructure  is  poor,  it  may  hamper  the 
performance  of  the  voice  biometric  system.  Third,  remote-ability,  which  is  one  of  voice 
biometrics  greatest  strengths  is  also  one  of  its  limitations.  Without  placing  constraints  on 
the  remote-ability  of  a  speech  application,  one  cannot  control  the  type  of  channel  (e.g., 
landline  or  different  types  of  cell  phones)  or  the  environment  (e.g.,  noisy  or  quiet 
background)  that  a  user  selects  to  dial-up  the  speech  application.  And  fourth,  as  with 
other  forms  of  biometrics  system,  system  spoofing  (identify  thief)  is  a  concern  that 
requires  careful  consideration  of  employment  tactics,  techniques,  and  procedures  (TTP). 
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III.  NUANCE  COMMUNICATIONS,  INC. 


A.  OVERVIEW 

Headquartered  in  Menlo  Park,  California,  Nuance  Communications,  Inc.,  is  a 
publicly  held  company  that  develops  speech  recognition,  speaker  verification  and  text-to- 
speech  applications.  Nuance  is  an  industry  leader  in  the  deployment  of  voice  interfaces 
that  provide  automated  speech  applications  to  enterprise  telecommunications  and  web- 
based  applications.  Nuance  currently  has  over  1,000  customers  who  have  purchased  their 
software  for  applications  ranging  from  banking,  stock  trading,  product  ordering,  personal 
assistants,  voice-activated  dialing,  call  routing,  and  voice  portal  services.  Some  of  their 
clients  includes:  Cingular  Wireless,  Sprint  PCS,  T-Mobile,  Japan  Telecom,  Banco 
Bradesco,  British  Airways,  Charles  Schwab,  Merrill  Lynch,  General  Motor's  OnStar  and 
United  Parcel  Services  [17]. 

More  recently  on  May  9th,  2005,  ScanSoft  (another  industry  leader  in  voice 
interfaces)  and  Nuance  announced  that  they  have  signed  a  definitive  agreement  whereby 
ScanSoft  will  acquire  all  of  the  outstanding  common  stock  of  Nuance,  merging  the  two 
organizations  into  a  single  company-retaining  the  corporate  identity  of  Nuance 
Communications,  Inc.  [18]. 

Provided  in  this  chapter  is  a  general  overview  of  Nuance’s  core  technologies, 
platform  and  packaged  applications.  The  below  information  was  gathered  from 
datasheets  that  are  readily  accessible  from  Nuance’s  website  at  http://www.nuance.com/ 
prodserv/prodnuance.html  and  can  also  be  found  in  Nuance's  "Nuance  Voice  Platform 
(NVP):  Getting  Started  Guide"  [19]. 

B.  CORE  TECHNOLOGIES 

Nuance’s  core  technologies  are  comprised  of  three  primary  engines:  speech 
recognition,  text-to-speech,  and  speaker  verification  that  enable  recognition  and 
understanding  of  simple  responses  and  complex  conversational  requests,  the  conversion 
of  written  information  into  speech,  and  the  authentication  of  an  individual's  identity. 
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First  is  Nuance's  current  release  of  speech  recognition  software,  Nuance  8.5, 
which  is  based  on  a  distributed  client/server  architecture  that  provides  scalable  operation. 
A  major  advantage  of  Nuance  8.5  is  that  it  supports  simultaneous  load  balancing  and 
fault  tolerance  across  speech  recognition,  speaker  verification  and  text-to- speech 
operations  to  ensure  efficient  use  of  system  resources. 

Nuance  8.5  supports  many  languages,  including  American  English, 
Australian/New  Zealand  English,  Canadian  French,  Cantonese,  European  French, 
German,  Italian,  Japanese,  Jordanian  Arabic,  Mandarin,  Portuguese,  Spanish,  Swedish 
and  UK  English.  In  addition  to  multilingual  support,  Nuance  8.5  also  offers  numerous 
advanced  features  and  capabilities.  Listed  below  are  some  of  the  advanced  features  and 
capabilities  available  using  Nuance  8.5  (for  a  complete  listing  of  these  features  refer  to 
Nuance’s  website): 

•  Say  Anything  is  a  feature  that  includes  Nuance’s  statistical  language 
models  (SLM)  and  robust  natural  language  interpretation  (robust  NL) 
technologies.  It  enables  automation  of  complex  and  open-ended  dialogs 
that  are  difficult  or  impossible  to  implement  using  traditional  grammars. 

XJVL 

•  Listen  &  Learn  is  a  task  adaptation  feature.  Task  adaptation  is  a  self¬ 
tuning  feature  of  the  Nuance  System  that  automatically  improves 
recognition  performance  of  deployed  applications. 

TM 

•  AccuBurst  is  a  dynamic  accuracy  feature  that  allows  the  recognizer  to 
trade  off  accuracy  against  speed  according  to  the  load  of  the  machine  on 
which  it  is  running.  With  dynamic  accuracy  turned  on,  the  system  uses 
resources  when  they  are  available.  The  recognition  rate  is  then  improved 
during  non-busy  hours  without  any  noticeable  slowdown  for  the  user. 

Second  is  Nuance’s  text-to-speech  (TTS)  software,  Nuance  Vocalizer  4.0,  which 
delivers  text-based,  frequently  changing  information  over  the  telephone  with  a  natural 
sounding  voice.  It  also  reduces  the  need  to  pre -record  information  required  in 
applications,  reducing  the  overall  costs  of  voice-driven  application  development.  Nuance 
Vocalizer  4.0  is  currently  available  in  U.S.,  U.K.  and  Australian  English,  in  both  male 
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and  female  voices,  and  Canadian  French  and  Latin  American  Spanish  in  female.  Nuance 
also  supports  a  total  of  18  TTS  languages  through  a  combination  of  Nuance  Vocalizer  4.0 
and  partner  languages.  Arabic  TTS  is  currently  not  available  in  Vocalizer  4.0. 

Third  is  Nuance’s  voice  authentication  software,  Nuance  Verifier  3.5.  Verifier 
3.5  enables  users  to  be  identified  and  authenticated  simultaneously  based  on  their  voice 
biometrics.  The  technology  is  not  currently  BioAPI-compliant.  The  technology  supports 
several  languages  including:  Australian/New  Zealand  English,  Brazilian  Portuguese, 
Canadian  French,  Cantonese  Chinese,  Dutch,  European  French,  European  Spanish, 
German,  Italian,  Japanese,  Korean,  Latin  American  Spanish,  Mandarin  Chinese,  South 
African  English,  Swedish,  US/Canadian  English  and  UK  English.  Arabic  is  currently  not 
supported. 

Nuance  Verifier  3.5  has  several  features  that  place  it  prominently  above  many  of 
its  competitors: 

•  Verifier  offers  three  modes  of  operation  for  enrollment  and  verification: 
Text-dependent,  Text-prompted,  and  Text-independent  modes.  In  text- 
dependent  mode,  the  same  utterance  is  used  for  enrollment  (training)  and 
verification.  In  text-prompted  mode,  verification  is  performed  against  a 
phrase  that  was  not  necessarily  used  for  training,  but  the  Verifier  knows 
what  the  verification  phrase  should  be.  In  text-independent  mode, 
verification  is  performed  against  a  phrase  that  was  not  necessarily  used  for 
training  and  the  Verifier  does  not  know  what  the  verification  phrase 
should  be. 

•  Verifier  uses  variable-length-verification  (VLV),  a  mechanism  that 
provides  accurate  results  with  the  smallest  number  of  verification 
utterances. 

•  Verifier  uses  online  adaptation,  which  is  a  feature  that  allows  a  system  to 
adapt  a  stored  voice  model  automatically  during  a  verification  session  if  it 
determines  that  the  user  is  the  true  speaker. 
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•  Verifier  can  accurately  verify  individuals  across  cross  channels.  For 
instance,  a  person  can  enroll  using  a  landline  telephone  and  be  verified  on 
a  cellular  phone. 

•  Verifier  can  effectively  filter  out  background  noises.  This  is  one  reason 
Nuance  notes  that  Sprint  PCS  and  GM  OnStar  use  Nuance  technology  for 
their  voice  interface. 

•  Verifier's  voice  model,  referred  to  as  a  “voiceprinf  ’  by  Nuance,  remains  at 
a  constant  size  of  20  kilobytes.  Nuance's  voice  models  are  encrypted  and 
stored  in  standard  scalability  databases,  such  as  Oracle  and  ODBC- 
compliant  databases.  These  databases  can  be  networked  so  that  one 
centralized  repository  can  serve  multiple  call-centers. 

C.  VOICE  PLATFORM 

Nuance  core  technologies  reside  on  a  platform  called  Nuance  Voice  Platform 
(NVP)  3.0.  Platforms  are  the  foundation  on  which  voice  applications  are  developed  and 
deployed.  They  execute  the  commands  and  logic  specified  by  the  voice  application, 
provide  the  speech  processing  capabilities,  enable  application  creation,  interface  to  back¬ 
end  systems  and  call  center  infrastructure,  and  provide  system  management  and 
administration  capabilities. 

NVP  3.0  is  based  upon  Voice  Extensible  Markup  Language  (VoiceXML)  2.0 
markup  language  standard.  VoiceXML  2.0  is  the  current  international  standard 
developed  by  World  Wide  Web  Consortium  (W3C)  VoiceXML  Lorum.  VoiceXML  2.0 
is  used  to  define  a  standard  dialog  design  language  that  developers  could  use  to  build 
conversational  applications.  VoiceXML  is  designed  to  create  audio  dialogs  that  feature 
synthesized  speech,  digitized  audio,  recognition  of  spoken  and  DTML  key  input, 
recordings  of  spoken  input,  telephony,  and  mixed  initiative  conversations  [20]. 

NVP  3.0  consists  of  four  major  components,  which  are  described  below,  and  is 
shown  in  Ligure  6. 
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Figure  6.  Architecture  View  of  Nuance  Voice  Platform  3.0  [From  Ref.  19] 

•  The  Nuance  Conversation  Server  includes  a  VoiceXML  Interpreter 
integrated  with  Nuance’s  speech  recognition,  text-to-speech  and  voice 
authentication  technologies.  Using  standard  Internet  protocols,  the 
Nuance  Conversation  Server  fetches  VoiceXML  applications  generated  by 
the  Nuance  Application  Environment  or  other  application  frameworks. 
The  Nuance  Conversation  Server  also  provides  the  interfaces  to  the 
telephony  network  via  support  for  commercial-off-the-shelf  (COTS) 
telephony  network  interface  cards  or  through  support  for  Voice  over 
Internet  Protocol  (VoIP)  through  Session  Initiated  Protocol  (SIP). 

•  The  Management  Station  provides  an  intuitive  graphical  user  interface 
(GUI)  for  configuring,  deploying,  administering,  and  managing  voice 
applications.  It  also  provides  centralized  management  of  the  services  on 
the  Conversation  Server  hosts.  The  three  main  functions  of  the 
management  station  are  System  Management  and  Control,  System 
Performance  Analysis  and  Data  Management. 
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•  The  Nuance  Application  Environment  (NAE)  is  an  integrated  graphical 
application  development  and  runtime  environment  that  facilitates  the 
design,  development,  deployment,  and  maintenance  of  speech 
applications.  This  framework  can  run  on  widely  used  application  servers 
to  create  dynamically  generated  VoiceXML  applications.  The  voice 
application  can  readily  integrate  to  a  broad  range  of  backend  databases, 
applications,  and  legacy  systems  using  web  services  standards  and  a 
variety  of  pre-packaged  interfaces  offered  by  application  server  vendors. 
Application  developers  can  also  analyze  and  tune  voice  application 
performance  and  usability.  Additionally,  a  key  feature  of  NAE  is  that  it  is 
an  intuitive  development  environment  that  enables  reusability  of 
application  modules. 

•  The  Nuance  Computer  Telephony  Integration  (CTI)  Gateway  provides 
packaged  integrations  to  leading  CTI  servers.  NVP  3.0  can  be  integrated 
into  CTI  environments  from  leading  vendors  such  as  Aspect,  Cisco,  and 
Genesys,  allowing  enterprises  to  deploy  a  best-of-breed,  integrated  contact 
center  solution  that  can  provide  callers  with  a  consistent,  high-quality  user 
experience. 

D.  PACKAGED  SPEECH  APPLICATIONS 

Nuance  also  offers  several  packaged  off-the-shelf  and  easily  configurable 
products  that  can  enable  enterprises  to  shorten  application  development  and  deployment 
time  dramatically,  accelerate  return  on  investment,  and  cost-effectively  access  advanced 
application  design  and  development  experience.  Provided  below  are  two  packaged 
applications  that  Nuance  currently  offer. 

•  Nuance  Caller  Authentication  (NCA)  1.0  is  a  packaged  application  that 
automatically  authenticates  callers  prior  to  accessing  account  or  personal 
information  using  automated  systems  or  talking  with  a  customer  service 
representative.  Powered  by  Nuance  Verifier,  NCA  1.0  authenticates 
callers  based  on  the  unique  characteristics  of  their  voice.  Using  voice 
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authentication  results  in  higher  levels  of  security  than  more  traditional 
means  of  identifying  callers,  such  as  touch-tone  systems  that  require 
personal  identification  numbers  (PINs)  or  agent  questions. 

Nuance  Call  Steering  (NCS)  1.0,  powered  by  Say  Anything™ 
technology,  allows  callers  to  interact  with  an  automated  speech- 
recognition  based  solution  that  enables  them  to  speak  naturally  and  then  to 
be  quickly  routed  to  the  correct  destination.  NCS  1.0  serves  as  a  gateway 
to  an  organization’s  contact  center,  enabling  companies  to  establish  a 
single  point  of  contact  and  instantly  route  callers  to  the  customer  care 
solution  best  equipped  to  meet  their  needs. 
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IV.  BILINGUAL  VOICE-ACTIVATED  MENU-DRIVEN  SYSTEM 


A.  PHASE  1A  OVERVIEW 

The  primary  objective  of  this  phase  of  the  IEVAP  is  to  develop  a  bilingual 
(English  and  Jordanian-Arabic)  speech  application  that  demonstrates  the  viability  of 
speech  technology  to  support  operations  in  Iraq. 

The  purpose  of  the  bilingual  Baghdad  Central  Correctional  Facility  (BCCF) 
Visitor  Center  Application  is  to  demonstrate  the  feasibility  of  using  COTS  technology  in 
order  to  create  a  pilot  proof-of-concept  (POC)  system  in  order  to  expedite  a  visitor’s 
entry  to  a  controlled  facility/secure  space  and  to  assist  in  managing  detention  visitation  at 
BCCF.  It  is  envision  that  this  application  would  assist  in: 

•  Expediting  and  improving  the  visitation  process  at  the  BCCF,  thereby 
improving  the  overall  force  protection,  security,  and  the  management  of 
the  detention  facility  and  the  detainees. 

•  Reducing  the  necessity  for  travel  by  visitors  to  schedule  meetings  with 
detainees  at  BCCF  and  to  better  manage  access  to  detainees  on  the  day  of 
visitation. 

•  Providing  a  method  of  generating  a  voice  biometric  database  that  will  be 
of  potential  value  in  combating  the  insurgency  in  Iraq. 

•  Improving  public  relations  with  the  Iraqi  people  by  providing  improved 
and  safer  access  to  detainees. 
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There  are  two  applications  envisioned  for  the  demonstration  of  this  pilot  system: 

•  BCCF  Visitor  Verification  and  Access  Application.  An  application  is 
envisioned  whereby  an  Enrollee  would  arrive  at  a  predetermined  visitation 
time  at  BCCF,  speak  into  a  device,  have  his  or  her  voice  authenticated, 
and  be  granted  access  to  the  visitor’s  area.  The  BCCF  visitor  verification 
application  is  intended  to  reduce  the  level  of  “hands  on”  validation 
required  by  security  personnel  and  to  increase  the  speed  with  which  an 
Enrollee  can  have  a  scheduled  meeting  with  a  Detainee.  The  BCCF 
application  is  expected  to  complement  or  improve  on  existing  visitation 
procedures.  The  improved  ease  of  access  might  encourage  individual 
enrollment  [1], 

•  BCCF  Visitation  Scheduling  Application.  Visitation  scheduling  is  a 
complementary  application.  A  previously  enrolled  individual  would  have 
the  ability  to  gain  access  to  a  BCCF  visitation  scheduling  application. 
This  application  would  be  remotely  accessible  by  landline  or  cell  phone. 
When  the  application  is  accessed,  the  BCCF  would  take  the  applicant 
through  a  series  of  steps  to  authenticate  the  requestor’s  voice  biometric, 
and  only  upon  successful  authentication  would  the  requestor  be  granted 
access  to  the  detainee  visitation  scheduling  application.  Voice  prompts  or 
some  other  method  would  guide  the  Enrollee  through  a  scheduling  system 
with  the  result  being  the  generation  of  a  designated  time  to  arrive  at  BCCF 
for  a  visit.  There  is  potential  for  a  corollary  use  of  voice  authentication, 
where  the  requestor,  by  stating  the  name  of  the  Detainee,  could  be  added 
to  the  Detainee’s  visitor  schedule,  allowing  detainment  facility  staff  to 
pre-screen  visitors  [1]. 

The  application  whose  requirements  are  specified  in  this  document  allows  callers 
to  obtain  information  on  visitation  information,  obtain  general  directions  to  the  BCCF, 
and  schedule  appointments  (simulated)  to  visit  detainees  at  BCCF  in  both  English  and 
Jordanian-Arabic,  see  Figure  7. 
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Figure  7.  High-Level  Diagram  for  BCCF  Visitor  Center  Application 

Figure  7  (as  depicted  above)  is  a  high-level  call-flow  diagram  for  the  BCCF 
Visitor  Center  Application.  In  this  application,  a  Caller  is  prompted  by  the  system  to 
choose  a  language  to  proceed  in,  either  in  English  or  in  Jordanian- Arabic.  Once  a  Caller 
selects  a  language,  the  system  then  proceeds  to  the  language  specific  main  menu.  At  this 
point,  the  system  asks  the  Caller  to  select  an  application  to  obtain  information  on 
visitation  information,  to  obtain  general  directions  to  the  detention  facility  (BCCF),  or  to 
schedule  an  appointment  (simulated)  to  visit  a  detainee  at  BCCF.3  If  the  Caller  chooses 
to  receive  visitation  information  or  obtain  directions  to  the  detention  facility,  speaker 
verification  is  not  required.  The  prerecorded  prompts  will  automatically  play  when 
required.  If  the  Caller  chooses  to  schedule  a  new  appointment  or  to  check  up  on  an 
existing  appointment,  speaker  verification  is  required  before  the  Caller  is  granted  access 
to  the  automated  scheduling  system.  This  is  to  ensure  that  access  is  only  given  to 
authorize  visitors  of  the  BCCF  detainees. 


3  This  prototype  application  is  intended  to  demonstrate  the  call-flow  of  the  BCCF  application  in  English  and  in 
Jordan-Arabic,  and  it  is  not  connected  to  a  backend  database,  as  such,  the  appointment  scheduling  is  a  simulated 
process. 
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B.  EQUIPMENT  LIST 

The  pilot  POC  system  used  the  following  equipment  (hardware,  software,  and 
peripherals)  to  develop  and  demonstrate  the  application. 

1.  Hardware 

Based  on  the  software  requirements  of  Nuance,  NPS  purchased  the  following 
hardware  to  develop  and  demonstrate  this  application,  see  Figure  8. 

•  Dell  Latitude  15.4”  D810  Intel  Pentium  M770  Processor  (2.13  GHz),  2 
GB  DDR2-533  SDRAM,  80GB  Hard  Drive,  Intel  Pro/Wireless  2915 
(802.11  a/b/g,  54  Mbps)  and  integrated  Bluetooth 

•  Dell  Latitude  12”  D410  Intel  Pentium  M755  Processor  (2.00  GHz),  2  GB 
DDR2-533  SDRAM,  80GB  Hard  Drive,  Intel  ProAVireless  2915  (802.11 
a/b/g,  54  Mbps)  and  integrated  Bluetooth 

•  Sony  F-V420  Unidirectional  Natural  Sound  Vocal  Microphone. 

Two  computers  (host)  are  required  to  demonstrate  the  bilingual  application  [21]. 4 
The  laptop  computers  listed  above  were  chosen  for  their  processing  power,  memory 
capability,  and  mobility.  The  input  device  (microphone)  was  selected  based  on  its  ease  of 
use  in  developing  and  testing  the  speech  application. 


4  Currently,  Nuance  cannot  run  multilingual  applications  on  the  same  host.  Thus  two  hosts  are  required,  one 
operating  under  English  locale  in  Windows  2000  and  the  other  operating  under  Jordanian-Arabic  locale  in  Windows 
2000.  Locale  is  an  environment  variable  that  is  set  within  the  Microsoft  Windows  Operating  System.  Locale  is  a  set  of 
information  that  corresponds  to  a  given  language  and  country.  The  code  locale  setting  affects  the  language  of  terms 
such  as  keywords  and  defines  locale-specific  settings  such  as  the  decimal  and  list  separators,  date  formats,  and 
character  sorting  order.  Nuance  uses  the  locale  environment  variable  to  identify  the  primary  locale  for  the  platform. 
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Figure  8.  Diagram  of  BCCF  Visitor  Center  Application  System 
2.  Software 

Listed  below  are  the  software  applications  used  to  develop  and  demonstrate  this 
application: 

•  Microsoft’s  Windows  2000  Professional 

•  Sun’s  Java  2  SDK  1.3. 1_15 

•  Nuance  Voice  Platform  3.0.  SP4 

•  Nuance  Application  Environment  3.0  SP4 

•  Nuance  Vocalizer  4.0 


•  SIPFoundry’s  SipXphone. 

Currently,  Nuance  is  only  tested  against  Microsoft  Windows  2000  operating 

system.  However,  Nuance  is  capable  of  operating  under  Microsoft’s  Windows  2003  and 

Windows  XP  Professional  operating  systems.  Sun’s  Java  2  SDK  is  a  development 

environment  for  building  applications,  applets,  and  components  using  the  Java 

programming  language.  This  software  is  downloadable  from  Sun’s  website  at 

http://java.sun.eom/j2se/l.3/  download.html.  The  SIPfoundry  SipXphone  was  selected 

for  its  compatibility  with  Nuance’s  software.  SIPfoundry’ s  SipXphone  is  shareware 
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program  that  can  be  downloaded  at  SIPfoundry’s  website  at  www.sipfoundry.org. 
SipXphone  was  formerly  known  as  Pingtel's  instant  xpressa  softphone,  and  it  is  a  fully 
functional  SIP  softphone  that  mns  on  Microsoft  Windows  and  Linux  operating  systems. 

The  bilingual  BCCF  Visitor  Center  Application  was  designed  and  developed 
using  Nuance  Application  Environment  (NAE).  As  mentioned  in  Chapter  III,  NAE  is  an 
environment  within  NVP  where  applications  can  be  developed,  tested,  and  executed. 
Information  provided  on  the  following  pages  was  referenced  from  Nuance's  V-Builder 
3.0  Feature  Pack  1  User's  Guide  [22].  NAE  consists  of  two  components:  V-Builder  and 
V-Server. 

V-Builder  is  the  design  component  of  NAE.  V-Builder  is  a  productivity  tool  that 
facilitates  many  of  the  functions  required  to  develop  open,  standards-based  speech 
applications,  such  as: 

•  VoiceXML  code  generation 

•  Grammar  development  and  testing 

•  Prompt  recording  and  playback 

•  Voice  application  testing. 

V-Builder  also  facilitates  many  tasks  common  to  all  application  development, 
including  project  management,  version  control,  and  application  deployment. 
Additionally,  V-builder  allows  developers  to  instant  generate  preformatted  Dialog 
Specifications  document,  which  affords  developers  the  ability  to  document  their 
applications  design.  Figure  9,  is  a  screenshot  of  the  bilingual  BCCF  Visitor  Center 
Application  within  the  V-builder  environment. 
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Figure  9.  BCCF  Visitor  Center  Application  within  NAE 

V-Builder  provides  an  integrated  environment  for  developing  and  testing  voice- 
enabled  applications  based  on  the  VoiceXML  2.0  markup  language  standard.  V-builder's 
primary  goal  is  to  bring  the  advantages  of  web-based  development  and  content  delivery 
to  interactive  voice  response  applications.  It  simplifies  speech  application  development 
by  allowing  a  developer  to  create  speech  applications  graphically.  A  developer  can  pick 
dialog  states  from  a  palette  of  choices  and  drop  them  into  the  graphical  call  flow.  The 
developer  then  defines  the  state  details  in  related  property  sheets.  Based  on  the  design 
created,  V-Builder  then  generates  the  VoiceXML  code  for  the  application.  The 
advantage  of  using  V-builder  is  that  no  knowledge  of  VoiceXML  or  programming  is 
required  to  create  a  working  sample  or  prototype  speech  application. 

The  other  component  of  NAE  is  V-Server.  V-Server  is  the  runtime  component  of 
the  NAE.  V-Server  is  a  web  application  that  runs  inside  a  J2EE  web  server.  It  currently 
supports  the  IBoss,  WebLogic,  and  WebSphere  web  servers.  V-Server  manages  and 
exposes  functionality  for  V-Builder  speech  applications  at  runtime,  enabling  them  to: 
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•  Access  data  from  Enterprise  Information  Systems  (EIS)  such  as  Oracle, 
PeopleSoft,  and  Siebel  that  hold  customer  data. 

•  Integrate  with  third-party  Computer  Telephony  Integration  (CTI)  servers 
like  the  Genesys  IVR  server  and  CiscoICM,  which  provide  features  like 
screen  pops,  call  routing  based  on  callers’  needs  and  agents’  skills,  and 
universal  queue  management  (that  is,  using  a  single  queue  to  manage 
telephony  and  web-based  queries.) 

V-Server  also  provides  operation,  administration  and  maintenance  integration 
with  NVP  so  that  when  speech  application  is  generated  by  V-Builder,  a  user  can  monitor 
and  control  it  through  the  Nuance  Management  Station. 

C.  APPLICATION  DEVELOPMENT  PROCESS 

The  BCCF  Visitor  Center  Application  was  developed  using  Nuance's  project 
methodology  as  described  in  the  Nuance  NVP  Application  Developer's  Guide  [23].  The 
Nuance  methodology  consists  of  five  phases  which  are 

•  Phase  1:  Requirement  Analysis  consists  of  identifying  the  business,  user, 
and  application  requirements 

•  Phase  2:  Design  focuses  on  the  user  interface  by  defining  dialogs, 
prompts,  and  grammars,  as  outlined  in  the  requirement  phase 

•  Phase  3:  Implementation  consists  of  building  the  speech  application, 
recording  audio  prompts,  and  completing  the  recognition  package 

•  Phase  4:  Testing  focuses  on  testing  the  speech  application  for  dialog 
traversal  and  system  load,  speech-recognition  performance,  and  usability 
testing 

•  Phase  5:  Tuning  and  Monitoring  is  the  process  of  improving  a  speech 
application  based  on  deployment  data.5 


5  For  the  development  of  this  prototype  POC  system,  only  the  first  four  phases  were  implemented.  Phase  5— 
Tuning  and  Monitoring  was  not  conducted  because  this  application  is  a  proof-of-concept  application  that  was  not 
deployed  as  an  operational  application,  as  such,  no  deployment  data  was  collected. 
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Appendix  A  of  this  thesis  provides  the  Dialog  Specification  for  the  bilingual 
BCCF  Visitor  Center  Application.  The  Dialog  Specification  document  encapsulates  all 
of  the  required  information  to  create  this  program.  Provided  below  is  the  pertinent 
information  regarding  the  development  of  this  pilot  POC  system. 

1.  Requirements  Collection 

The  requirements  used  to  develop  this  application  were  gathered  from  the 
following  sources: 

•  E-mail  correspondence  from  Mr.  Doman  McArthur,  OSD  dtd  22  Feb  05 
and  1 1  Dec  04 

•  E-mail  correspondence  from  Maj  Robert  Berry,  USA  dtd  25  Jan  05 

•  Iraqi  Enrollment  via  Voice  Authentication  Project  Concept  of  Operations 
Version  2.0 

•  Naval  Postgraduate  School  Proof-of-Concept:  Iraqi  Enrollment  via  Voice 
Authentication  Project  Test  Plan  Version  1.0 

•  Baghdad  Central  Correctional  Facility  Standard  Operating  Procedure 
(SOP)  10:  SOP  Family  Visitation  dtd  3  Jun  04 

•  BCCF  SOP  14:  SOP  Visitation  Center  dtd  30  Aug  04. 

2.  User  Definition 

Based  on  email  correspondence  with  the  Operations  Officer  of  the  BCCF  [24],  the 
following  user  profile  was  generated:  Visitors  of  detainees  are  between  the  ages  of  18  and 
50.  They  consist  mostly  of  family  members  of  the  detainees,  often  wives,  children, 
mother,  and  fathers.  It  is  assumed  that  the  visitors  are  generally  repeat  visitors.  It  is  also 
assumed  that  visitors  are  unfamiliar  with  the  use  of  speaker  verification  and  ASR 
technology. 
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3.  User  Expectation 

Based  on  the  data  collected  in  support  of  defining  this  pilot  POC  application,  the 
following  are  assumed  user  expectations: 

•  It  is  assumed  that  Callers  of  this  pilot  POC  system  will  be  unfamiliar  with 
the  use  of  speaker  verification  and  automated  speech  recognition  (ASR) 
technology.  As  such,  a  help  menu  and  a  directed  dialog  are  required  to 
assist  Callers  to  complete  calls. 

•  This  is  an  official  Department  of  Defense  (DoD)  system;  as  such  a  persona 
of  professionalism  is  required.  However  special  attention  must  be  given  to 
the  fact  that  the  majority  of  Callers  to  this  system  will  be  the  family 
members  of  the  Detainees;  therefore,  careful  consideration  of  their  culture 
and  customs  is  also  a  necessity.  Additionally,  as  with  the  existing  US 
Correction  Facility  visitation  information  system,  Callers  of  this  system 
are  expected  to  request  directions  to  the  detention  facility  and  will  request 
visitation  information,  such  as  hour  of  operations  or  general  visitation 
procedures. 

•  For  the  purposes  of  the  pilot  POC  system,  it  is  assumed  that  Callers  will 
follow  the  prompted  menu  structure.  This  POC  system  will  employ  a 
directed  dialog  vice  a  mixed-initiative  dialog.  In  a  directed  dialog,  the 
system  gives  the  Caller  a  list  of  options  at  the  beginning  of  the  interaction; 
it  then  prompts  the  Caller  to  make  a  selection.  In  a  mixed-initiative 
dialog,  a  Caller  chooses  what  he  or  she  wants  to  do  and  describes  it  in 
natural  language. 

4.  User  Success  Criteria 

It  is  assumed  that  the  user  success  criteria  for  this  application  are  task  completion, 
ease  of  call,  and  speed  of  call. 
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D.  APPLICATION  CALL-FLOW 


Provided  on  the  following  pages  is  a  description  of  the  BCCF  Visitor  Center  Call- 
Flow  to  include  the  actual  system  prompts.  Figure  10  is  a  diagram  of  the  described 
process.  For  additional  information  regarding  the  BCCF  Visitor  Center  Call-Flow  refer 
to  Appendix  A  (Dialog  Specification  for  BCCF  Visitor  Center  Application)  of  this  thesis. 


Baghdad  Central  Correctional  Facility  Visitor  Center  Application 


Figure  10.  Detailed  Call-Flow  Diagram  for  the  BCCF  Application 
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1. 


Start  (WelcomeBCCF) 


When  initially  calling  the  system,  the  Caller  is  greeted  with  a  bilingual  welcome 
message:  "Hi,  Welcome  to  Baghdad  Central  Correctional  Facility’s  Visitor  Center  (same 
prompt  repeated  in  Arabic)." 

2.  Language  Selection  (SelLanguage) 

After  the  initial  greeting,  a  Caller  is  prompted  to  select  a  language:  "To  continue 
in  English,  say  'English.'  To  continue  in  Arabic,  say  'Arabic'  (Arabic  welcome  prompt 
spoken  in  Jordanian- Arabic)."  Once  a  Caller  has  chosen  a  language,  the  system  proceeds 
to  the  language  specific  main  menu. 

3.  Language  Specific  Main  Menu  (MainMenu) 

Upon  reaching  the  language  specific  main  menu,  a  Caller  is  given  the  option  to 
hear  visitation  information,  obtain  general  direction  to  BCCF,  or  schedule  an 
appointment  to  visit  a  detainee:  “Thanks.  Please  select  from  the  following  options.  To 
get  general  visitor  information,  including  visiting  hours,  say  'information.'  To  get 
directions  to  our  facility,  say  'directions.'  To  set  up  a  meeting  using  our  automated 
scheduling  system,  say  ‘scheduling.’  ” 

4.  Visitation  Information  (Visitlnformation) 

If  a  Caller  selects  this  option,  the  system  plays  back  a  prerecorded  prompt  stating 
the  hours  of  operation  for  the  BCCF  Visitor  Center:  “Baghdad  Central  Correctional 
Facility  is  open  for  visitors  from  8  AM  to  4  PM,  Monday  through  Saturday.  Would  you 
like  to  hear  that  information  again  or  return  to  the  main  menu?  If  you’re  done  for  now, 
please  feel  free  to  hang  up.”6 


6  The  system  demonstration  in  Phase  1 A  is  limited  only  to  the  playback  of  hours  of  operations  for  BCCF.  Future 
prerecorded  prompts  can  contain  additional  sub-dialogs  detailing  additional  visitation  information,  such  as  BCCF's 
Visitation  Operation  Standard  Operations  Procedure  (SOP). 


32 


5. 


Directions  to  BCCF  (Directions) 


If  a  Caller  selects  this  option,  the  system  plays  back  a  prerecorded  prompt  stating 
general  directions  to  the  detention  facility:  “Baghdad  Central  Correctional  Facility  is 
located  20  miles  west  of  Baghdad,  in  the  town  of  Abu  Ghraib.  From  Baghdad,  go  west 
on  highway  six  for  18  miles  then  take  exit  nine  at  Abu  Ghraib.  Our  facility  is  located  two 
miles  southwest  of  exit  nine.  Would  you  like  to  hear  the  directions  again  or  return  to  the 
main  menu?  If  you’re  done  for  now,  please  feel  free  to  hang  up.” 

6.  Visitation  Scheduling  (Scheduling) 

If  a  Caller  selects  this  option,  the  system  plays  back  an  initial  prompt  asking  the 
Caller  if  he  or  she  has  enrolled  in  the  system.  If  the  Caller  replies  "yes,"  then  the  system 
will  proceed  to  the  speaker  verification  dialog.  If  the  Caller  replies  "no,"  the  system  will 
proceed  to  the  speaker  enrollment  dialog. 

System:  “In  order  to  use  our  automated  scheduling  system,  you  must  be  an 
enrolled  user.  Are  you  an  enrolled  user?  If  you  are,  say  ‘yes.  ’  If  you’re  not,  say 
‘no  ’  and  I’ll  help  you  to  enroll  in  our  system.  ” 

Caller:  “Yes.  ” 

System:  “To  get  started,  go  ahead  and  say  or  key-in  your  10-digit  account 
number.  ” 

Caller:  “No.  ” 

System:  “To  get  started  on  the  voice  enrollment  process,  1  need  your  10-digit 
account  number.  If  you  don ’t  have  an  account  number,  or  if  you’ve  lost  it,  please 
go  to  your  nearest  police  station  to  register  for  a  new  account.  If  you  have  the 
account  number,  go  ahead  and  say  or  key  it  in  now.  ” 

Note:  In  this  POC  application,  NPS  is  using  a  Caller’s  registration  number  as  the 
unique  identifier  to  match  a  Caller’s  voice  sample  with  his  or  her  stored  voice  model.  As 
mentioned  in  paragraph  1.1  of  the  IEVAP  CONOPS  2.0,  “There  is  no  consistent  method 
of  personal  identification  for  the  Iraqi  populace"  [1],  In  order  to  make  this  particular 
technology  work,  a  Caller  must  be  assigned  a  unique  identifier  to  match  a  Caller’s  voice 
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sample  with  the  Caller’s  stored  voice  model.  It  is  not  practical  to  use  names  as  the 
unique  identifier  because  numerous  people  can  have  the  same  name. 

Also,  the  designated  remote  system  enrollment  facility,  whether  it  is  a  police 
station  or  other  designated  facility,  must  have  the  capability  to  assign  visitor  registration 
or  account  numbers  and  to  have  access  to  the  BCCF  detainee  database  in  order  to  retrieve 
and  to  associate  a  visitor’s  registration/account  number  with  a  Detainee’s  Internment 
Serial  Number  (ISN). 

7.  Confirm  Visitor  Registration  (Account)  Number  (NbrCount2) 

If  the  caller  provides  a  10-digit  account  number,  the  system  asks  the  Caller  to 
confirm  his  or  her  answer.  If  the  Caller  confirms  his  or  her  answer,  the  system  then 
checks  to  see  if  the  account  number  is  valid  or  not.  Once,  the  system  has  validated  the 
account  number,  the  system  then  asks  the  Caller  to  repeat  from  one  to  nine  in  order  to 
authenticate  the  Caller’s  voice  biometric.  If  the  system  authenticates  the  Caller,  the 
system  proceeds  to  the  next  dialog.  If  the  system  does  not  authenticate  the  Caller,  the 
system  repeats  the  authentication  process.  If  on  the  third  attempt  the  system  cannot 
authenticate  the  Caller,  then  the  system  plays  back  a  prompt  informing  the  Caller  to  re¬ 
register  or  will  connect  the  Caller  to  a  live  agent  (if  available).7 

System:  “ Thanks ,  I  heard  8005551212  is  that  right?” 

Caller:  “Yes.  ” 

System:  “Now  to  verify  your  voice,  please  count  out-loud  from  one  up  to  nine.  ” 

Caller:  “ 1-2-3-4-5-6-7-8-9 ” 

System:  “ You’re  been  verified.  ” 


7  The  system  demonstration  in  Phase  1A  does  not  demonstrate  speaker  verification  technology.  This  feature  will 
be  simulated  with  ASR  prompts. 
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8.  Make  or  Confirm  Appointment  (DetailScheduling) 

If  the  system  authenticates  the  Caller,  the  system  asks  the  Caller  if  he  or  she  wants 
to  schedule  a  new  appointment  or  whether  he  or  she  wants  to  check  to  see  if  a  requested 
appointment  is  scheduled.  If  the  Caller  chooses  to  schedule  a  new  appointment,  then  the 
system  asks  the  Caller  to  provide  the  ISN  of  the  Detainee  the  Caller  wishes  to  visit.  If  the 
Caller  chooses  to  check  to  see  if  an  appointment  is  scheduled,  then  the  system  informs 
the  Caller  if  an  appointment  is  scheduled  or  not.8 

System:  “Next,  please  select  from  the  following  options.  If  you’d  like  to  make  a 

new  appointment,  say  'new  appointment.'  If  you’d  like  to  check  the  status  of  a 

pending  appointment,  say  ‘check  appointment. '  ” 

Caller:  “New  Appointment.  ” 

System:  “In  order  to  make  a  new  appointment,  you  must  have  the  detainee’s 

Internment  Serial  Number,  or  ISN.  Do  you  have  the  ISN?” 

Caller:  “Yes.  ” 

System:  “Please  say  or  key  in  all  9-digits  of  the  detainee’s  ISN.  ” 

Caller:  “ 111222333 .” 

9.  Confirm  Detainee  ISN  (DetaineelSN) 

The  system  asks  the  Caller  to  confirm  the  ISN  of  the  Detainee  the  Caller  wishes 
to  visit.  If  the  system  verifies  that  the  Caller  is  a  registered  visitor  of  the  Detainee,  then 
the  system  allows  the  Caller  to  proceed  to  scheduling.  If  the  system  does  not  verify  that 
this  is  a  registered  visitor  of  the  Detainee,  then  the  system  repeats  a  prompt  to  inform  the 
Caller  that  he  or  she  is  not  a  registered  visitor  of  the  Detainee.  The  system  then  prompts 
the  Caller  to  proceed  to  his  or  her  initial  system  enrollment  facility  to  add  the  Caller  to 
the  Detainee’s  list  of  registered  visitors. 

System:  “Thanks,  I  heard  111222333  is  that  right?” 

8  The  system  demonstration  in  Phase  1 A  does  not  provide  the  option  to  check  if  an  existing  appointment  request  is 
scheduled.  A  prerecorded  prompt  replies  that  there  are  no  pending  appointments.  “Based  on  our  records,  you  have  no 
scheduled  appointments  at  this  time.  If  you’ve  called  earlier  to  set  up  an  appointment,  note  that  it  takes  24  hours  for  the 
appointment  to  get  scheduled.  Please  check  back  at  a  later  time.” 
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Caller:  “Yes. 


System:  “Next,  please  wait  while  I  check  to  see  if  you  ’re  a  registered  visitor  of  the 
detainee  with  ISN  111222333.  ” 

System:  “Thanks.  I’ve  confirmed  that  you’re  a  registered  visitor  of  Abu  Musab 
Al-Zarqawi.  ” 

10.  New  Appointment  (GetVisitDate) 

Once  the  system  has  verified  the  Caller’s  identity  and  that  the  Caller  is  a 
registered  visitor  of  the  Detainee,  the  system  then  prompts  the  Caller  to  provide  the  day 
and  time  of  the  requested  visit  in  a  prescribed  format  such  as  May  21,  2005,  12  PM.9 

System:  “ Please  tell  me  the  date  for  when  you’d  like  to  visit  Abu  Musab  Al- 
Zarqawi.  Please  say  a  complete  date,  including  the  month,  day  and  year.  For 
example,  you  could  say  May  18,  2005.  ” 

Caller:  “ June  23,  2005.  ” 

System:  “Next,  tell  me  the  time  you’d  like  to  visit.  You  can  choose  any  time 
between  the  hours  of  8  AM  to  4  PM.  ” 

Caller:  “2:30  PM.  ” 

System:  “Thanks,  I  heard  that  you’d  like  to  visit  Abu  Musab  Al-Zarqawi  on  June 
23,  2005  at  2:30  PM  is  that  right?” 


9  There  is  a  difference  in  the  concatenation  strategy  for  the  reply  of  dates  in  Arabic  as  compared  to  English.  For 
instance,  in  English,  a  Caller  is  expected  to  say  a  date  in  the  following  format  "May  21,  2005";  however,  in  Arabic, 
Callers  use  digits  to  describe  dates,  such  as  "21-5-2005."  To  adjust  for  difference  in  this  concatenation  strategy,  an 
application  developer  can  write  a  grammar  file  (code)  that  allows  for  the  input  of  dates  in  the  following  format  dd-mm- 
yyyy.  Additionally,  Nuance’s  also  offers  “Say  Anything”  grammars,  which  is  a  feature  that  includes  Nuance’s 
statistical  language  models  (SLM)  and  robust  natural  language  inteipretation  (robust  NL)  technologies.  This  enables 
automation  of  complex  and  open-ended  dialogs  that  are  difficult  or  impossible  to  implement  using  traditional 
grammars.  For  this  pilot  POC  system,  neither  strategy  was  implemented  due  to  time  and  budgetary  constraint.  For  the 
Jordanian-Arabic  scheduling  application,  a  recording  prompt  was  substituted  for  the  date  recognition  process. 
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11.  Confirm  New  Appointment  (ConfirmDateTime) 

Once  the  caller  has  provided  the  required  information,  the  system  asks  the  Caller 
to  confirm  the  appointment.  If  the  Caller  replies  "yes,"  the  appointment  is  stored  in  a 
database  for  processing.  If  the  Caller  replies  "no,"  the  system  asks  the  Caller  what 
variables,  date  or  time,  the  Caller  would  like  to  change.  Once  the  change  is  completed, 
the  information  is  stored  in  a  database  for  processing. 

Caller:  “Yes.  ” 

System:  Thanks;  I've  submitted  the  details  of  your  request  for  this  visit.  Please 

call  us  back  in  24  hours  to  see  if  your  requested  visit  has  been  scheduled.  Thank 

you  for  Baghdad  Central  Correctional  Facility  Visitor  Center,  Good  Bye.” 

The  demonstration  of  Phase  1A  concludes  with  a  playback  confirmation  of  the 
requested  appointment. 

E.  PHASE  1A  SUMMARY 

In  this  chapter,  NPS  has  successfully  developed  and  demonstrated  a  bilingual 
voice-activated  menu-driven  system  based  upon  the  BCCF  scenario,  as  defined  by  the 
sponsor  of  this  project,  OSD.  The  purpose  of  the  BCCF  Visitor  Center  Application  was 
to  demonstrate  the  feasibility  of  using  low-cost  COTS  technologies  in  order  to  create  a 
pilot  proof-of-concept  (POC)  system  in  order  to  expedite  a  visitor’s  entry  to  a  controlled 
facility/secure  space  and  to  assist  in  managing  of  detention  visitation  at  the  BCCF. 
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V.  NPS  SPEAKER  VERIFICATION  TEST 


A.  PHASE  IB  OVERVIEW 

The  purpose  of  the  NPS  Speaker  Verification  Test  was  to  test  the  accuracy  claims 
of  Nuance’s  speaker  verification  technology  based  on  the  performance  measures  of  false 
reject  rate  (FRR)  and  false  accept  rate  (FAR).10  This  test  was  conducted  using  Nuance's 
packaged  speaker  verification  application,  Nuance  Caller  Authentication  (NCA)  1.0 
using  their  North  American  English  Language  Verification  Master  Package.  Powered  by 
Nuance's  Verifier,  NCA  uses  voice  biometric  technology  to  capture  the  physical  and 
behavioral  characteristics  of  the  human  voice  in  a  voice  model  [25]. 

B.  EQUIPMENT  LIST 

For  this  test,  the  following  equipment  (hardware,  software,  and  peripherals)  were 
used  to  test  and  to  demonstrate  this  application. 

1.  Hardware 

Based  on  the  software  requirements  of  Nuance,  NPS  purchased  the  following 
hardware  in  order  to  conduct  this  test,  see  Figure  11. 

•  Dell  Latitude  15.4”  D810  Intel  Pentium  M770  Processor  (2.13  GHz),  2 
GB  DDR2-533  SDRAM,  80GB  Hard  Drive,  Intel  Pro/Wireless  2915 
(802.11  a/b/g,  54  Mbps)  and  integrated  Bluetooth. 

•  Intel  NetStructure  PBX-IP  Media  Gateway,  8  Ports  (Analog  Model). 

The  laptop  computer  was  chosen  for  its  processing  power,  memory  capability, 
and  mobility.  Nuance  recommends  (at  a  minimum)  using  a  1  GHz  processor  with  2  GB 
RAM  on  Microsoft  Windows  2000  based  system.  In  distributed  architectures,  the 
minimum  requirement  is  3  GB  RAM.  The  Intel  NetStructure  PBX-IP  Media  Gateway 


I®  The  initial  objective  of  Phase  IB  of  the  IEVAP  was  to  compare  the  accuracy  claims  of  the  three  best-of-breed  COTS 
speaker  verification  vendors,  which  were  Nuance  Communications.  Inc.,  ScanSoft,  Inc.,  and  Voicevault  Ltd.  currently 
known  as  Biometric  Security  Ltd.  The  orginial  goal  was  to  compare  the  performance  of  best-of-breed  speaker 
verification  vendors  and  select  an  individual  vendor  to  develop  the  pilot  POC  speaker-verification  system.  However, 
due  to  self-elimination,  two  out  of  the  three  voice  vendors,  namely,  ScanSoft,  Inc.,  and  Voicevault  Ltd.,  were  not 
evaluated  in  this  research.  Hence,  Nuance  Communications,  Inc.  was  evaluated  in  this  project. 
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was  selected  for  its  compatibility  with  Nuance’s  software.  The  Intel  PBX-IP  Media 
Gateway  is  a  telephony  gateway  appliance  that  connects  to  as  many  as  eight  analog 
phone  lines  through  its  digital  telephony  interface  and  connects  to  a  LAN  via  a  10  BaseT 
or  100  BaseT  Ethernet  connector.  For  this  test,  an  analog  gateway  model  was  chosen 
over  a  digital  gateway  for  its  flexibility  in  connecting  to  various  telephone  line 
connections. 


Figure  11.  Diagram  of  NCA  Speaker  Verification  System 
2.  Software 

Listed  below  are  the  software  applications  used  to  conduct  this  test: 

•  Microsoft’s  Windows  2000  Professional 

•  Sun’s  Java  2  SDK  1.3. 1_15 

•  Nuance  Voice  Platform  3.0.  SP4 

•  Nuance  Caller  Authentication  (NCA)  1.0 

•  Nuance  Vocalizer  4.0 

•  Oracle’s  9i  Database 

•  SIPFoundry’s  SipXphone. 
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Currently,  Nuance  is  only  tested  against  Windows  2000  operating  system. 
However,  it  is  noted  that  Nuance  is  capable  of  operating  with  Microsoft’s  Windows  2003 
and  Windows  XP  Professional  operating  system.  Sun’s  Java  2  SDK  is  a  development 
environment  for  building  applications,  applets,  and  components  using  the  Java 
programming  language.  This  software  is  downloadable  from  Sun’s  website  at 
http://java.sun.com/j2se/  1. 3/download. html.  The  SIPfoundry  SipXphone  was  selected 
for  its  compatibility  with  Nuance’s  software.  SIPfoundry’s  SipXphone  is  a  shareware 
program  that  can  be  downloaded  at  SIPfoundry’s  website  at  www.sipfoundry.org. 
SipXphone  was  formerly  known  as  Pingtel's  instant  xpressa  softphone,  and  it  is  a  fully 
functional  SIP  softphone  that  runs  on  Microsoft  Windows  and  Linux. 

C.  TEST  ENVIRONMENT 

The  NPS  Speaker  Verification  Test  was  conducted  remotely.  All  calls  made  to 
the  system  were  routed  from  the  Caller’s  choice  of  communication  medium  (landline, 
cell  phone  or  VoIP)  to  the  NCA  system  via  three  analog  phone  lines  connected  to  the 
Intel  PBX-IP  Media  Gateway.  The  NCA  system  was  setup  in  the  Wireless  Warfare 
Laboratory  located  in  Glasgow  Hall  (Room  103)  at  NPS  in  Monterey,  California.  During 
the  setup  of  the  speaker  verification  test,  special  features  of  the  NCA  application  were 
intentional  disabled  in  order  to  determine  the  raw  estimates  of  the  accuracy  of  the  system 
without  any  fine-tuning.  The  two  features  that  were  disabled  included:  Variable  Length 
Verification  (VLV)  and  Online  Adaptation  [25]. 

•  Variable  Length  Verification  is  a  mechanism  used  by  NCA  for  providing 
the  most  accurate  results  based  on  the  fewest  utterances.  In  the  NPS 
Speaker  Verification  Test,  this  feature  was  intentionally  disabled  in  order 
to  collect  more  voice  data  for  the  offline  impostor  test. 

•  Online  Adaptation  is  a  feature  that  allows  a  system  to  adapt  a  stored  voice 
model  automatically  during  a  verification  session  if  it  determines  that  the 
user  is  the  true  speaker.  For  the  majority  of  calls,  the  system  collected  two 
utterances  during  the  verification  process. 
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D.  TEST  SCHEDULE 


Table  2  presents  the  planned  and  actual  completion  test  schedule  for  Phase  IB. 


Task 

Planned 

Completion  Date 

Actual 

Completion  Date 

System  Installation 

1  Apr  05 

On  Schedule 

System  Design  (Phase  IB  Test  Plan) 

1  Apr  05 

On  Schedule 

System  Test  1B.1 

(English  Speaker  Verification  Test  1) 

21-22  Apr  05 

20-24  Apr  05* 

System  Test  IB. 2: 

(English  Speaker  Verification  Test  2) 

5-6  May  05 

2-8  May  05* 

Nuance  Offline  Analysis 

13-20  May  05 

On  Schedule 

NPS  Analyze  Data/Draft  Report 

21-30  May  05 

On  Schedule 

Conduct  Demonstration 

&  Preliminary  Report  Submission 

31  May  05 

6  Jun  05 

Note  (*):  Test  dates  were  expanded  to  allow  for  additional  caller  participation. 

Table  2.  Phase  IB  Test  Schedule 


E.  TEST  PROTOCOL 

The  test  protocol  for  the  speaker  verification  test  consisted  of  four  steps.  In  step 
one,  invitation  letters  were  sent  via  email  to  participating  organizations  (OSD, 
Massachusetts  Institute  of  Technology  (MIT)  and  NPS)  requesting  volunteers  to 
participate  in  this  research.  The  invitation  letter  provided  the  prospective  volunteers  with 
a  general  overview  of  the  NPS  Speaker  Verification  Test,  to  include  a  sample  call  dialog 
of  the  speaker  enrollment  and  speaker  verification  process,  applicable  participation 

consent  forms,  and  post-test  survey.  And  as  part  of  the  NPS/DOD  regulations  for  the  use 
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of  human  subjects,  the  NPS  research  team  obtained  permission  from  the  NPS  Human 
Resource  Board  prior  to  conducting  any  testing.  For  additional  information  on  the 
Invitation  Letter  for  the  NPS  Speaker  Verification  Test  refer  to  Appendix  B  of  this  thesis. 
In  step  two,  on  specified  test  dates,  participants  were  asked  to  dial  a  given  telephone 
number  to  enroll  and  to  verify  their  voice  biometric.  Participants  were  given  the 
opportunity  to  call  into  the  test  system  during  a  24-hour  period  on  four  successive  days  to 
make  their  call(s).  In  step  three,  participants  were  asked  to  enroll  once  and  then  verify 
four  times  during  the  first  test  (20-24  Apr  05)  and  to  verify  again  six  times  during  the 
second  test  (2-8  May  05).  During  the  enrollment  process,  participants  were  asked  to 
register  with  the  system  with  a  unique  10-digit  identification  number  and  an  arbitrary  4- 
digit  personal  identification  number.  Participants  were  then  asked  to  say  the  numbers  1 
to  9  three  times.  These  three  instances  of  voice  samples  were  used  for  generating  a 
unique  model  of  the  participant’s  voice  pattern.  During  the  verification  process,  the 
participants  registered  with  the  unique  ID  and  then  were  asked  to  speak  the  sequences  of 
numbers  1  to  9,  a  total  of  two  times.  Finally,  in  step  four,  the  results  of  the  NPS  Speaker 
Verification  Test  was  published  and  disseminated. 

F.  TEST  ANALYSIS 

The  analysis  of  the  NPS  Speaker  Verification  Test  was  conducted  in  three  phases. 
The  first  phase  consisted  of  an  analysis  of  the  call  log  (basic  statistics)  of  the  verification 
test,  resulting  in  a  single  data-point  analysis.  The  second  phase  consisted  of  an  analysis 
of  the  off-line  impostor  test  conducted  by  Nuance  on  the  NPS  data  set,  resulting  in  a 
ROC  Curve  analysis.  Lastly,  the  third  analysis  phase  consisted  of  a  comparison  of  the 
single  data-point  analysis  with  the  results  of  the  ROC  Curve  analysis. 

1.  Basic  Statistics 

Provided  in  Figures  12  through  14  are  the  summary  of  the  basic  statistics  of  the 
NPS  Speaker  Verification  Test. 
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Figure  12  presents  the  aggregate  speaker  enrollment  data,  which  consisted  of  68 
test  subjects  enrolled  during  the  two  test  phases,  with  a  51 -speaker  enrollment  during  the 
first  test  phase  and  a  17-speaker  enrollment  during  the  second  test  phase. 


Date 


Figure  12.  Speaker  Enrollment  Report 

Figure  13  (on  page  45)  presents  the  aggregate  speaker  verification  data,  consisting 
of  411  verification  attempts  equally  divided  between  the  two  test  phases,  with  204 
verification  attempts  during  the  first  test  phase  and  207  verification  attempts  during  the 
second  test  phase.  Figure  14  (on  page  45)  presents  the  number  of  verification  attempts 
per  voice  model  (Caller).  Note  that  in  Figure  14,  two  callers  had  a  very  large  number  of 
verification  attempts  (combined  total  of  77  calls),  compared  to  others  (334  calls)  for  a 
total  of  411  speaker  verification  attempts  in  the  dataset.  In  a  subsequent  analysis,  this 
outlier  effect  is  accounted  for  by  computing  the  FRR  and  FAR  with  and  without 
including  the  two-outlier  cases. 
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Speaker  Verification  Attempts 


85 


68 


51 


34 


17 


Total  Number  of  Verification  Attempts:  41 1 
Phase  I:  204  Attempts 
Phase  II:  207  Attempts 


Date 


Figure  13.  Speaker  Verification  Report 
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Verification  Attempts  by  Voice  Models 


Call-Log  Analysis: 

46  verification  attempts  out  of  a  total  of  41 1  verification 
(1 1 .1%)  were  rejected  by  the  system  as  valid  speakers. 

Phase  1:  24  out  of  204  (1 1 .8%)  were 
Phase  II:  22  out  of  207  (10.6%)  were 

rejected 

rejected 

12  Calls  (Failure  to  Enroll) 
12  Calls  (Incomplete  Data) 
10  Calls  (Correct  Rejects) 

12  Calls  (True  Failures) 

Voice  Model 


Figure  14.  Number  of  Verification  Attempts  per  Voice  Model  (Caller)  Report 
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2.  Nuance  ROC  Curve  Analysis 

Upon  completion  of  the  NPS  Speaker  Verification  Test,  the  raw  test  data  were 
extracted  from  the  system  and  sent  to  Nuance  for  their  offline  analysis.  The  offline-test 
performed  by  Nuance  consisted  of  a  test  whereby  each  speaker's  verification  attempt  was 
tested  against  every  enrolled  voice  model  in  the  database.  This  offline  impostor  test 
resulted  in  a  series  of  ROC  Curves  that  plotted  the  FAR  versus  the  FRR  at  various  system 
defined  thresholds.  The  EER  of  the  system,  the  points  on  the  ROC  Curve  at  which  the 
FAR  equals  the  FRR,  was  also  measured  and  reported.  The  process  for  the  ROC  Curve 
generation  consisted  of  five  steps.  In  step  one,  raw  data  from  the  NCA  application  was 
extracted  via  a  program  called  “TuningExport”  [25].  In  step  two,  a  pass  at  generating  the 
basic  statistics  of  the  NCA  test  application  was  generated.  In  step  three,  the  failed 
verification  attempts  were  validated  to  determine  which  calls  were  correct  rejects.  In  step 
four,  a  second  pass  at  the  basic  statistics  of  the  NCA  test  application  was  generated 
(incorporating  the  correct  rejects  from  the  previous  step).  And  in  step  five,  the  ROC 
Curve  was  generated  using  a  Nuance  utility  called  "batchrec"  [25]. 

Figures  15  to  18  are  the  ROC  Curves  plots  generated  from  Nuance's  offline 
analysis.  Figure  15  is  the  ROC  Curve  diagram  of  the  NPS  Speaker  Verification  Test  data 
set.  An  inspection  of  Figure  15  shows  an  EER  of  3.0%.  Figure  16  is  a  ROC  Curve  plot 
with  and  without  the  inclusion  of  identical  speakers.  Figure  17  is  a  ROC  Curve  plot  with 
and  without  the  inclusion  of  the  two  most  frequent  speakers,  termed  outliers.  Finally, 
Figure  18  is  a  ROC  Curve  plot  by  test  phases.  Note  that  in  Figure  18,  Phase  Two's  EER 
of  3.4%  was  slightly  higher  versus  the  Phase  One's  EER  of  2.5%.  This  may  be  explained 
due  to  the  session  effect.1 1 


1 1  A  session  effect  refers  to  the  nature  of  the  variation  in  the  voice  quality. 
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ROC  Curve 


Figure  15.  ROC  Curve  for  NPS  Speaker  Verification  Test 


ROC  Curve 


Figure  16.  ROC  Curves  (with  and  without  Identical  Speakers) 
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Figure  17.  ROC  Curves  (with  and  without  Outliers) 
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Figure  18.  ROC  Curves  (by  Test  Phase) 
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Figure  19  compares  the  NPS  Speaker  Verification  Test  data  set  with  Nuance's 
comparison  data  set.  When  compared  to  the  NPS  data  set,  the  average  values  of  FRR  and 
FAR  from  Nuance's  similar  data  sets  fell  within  the  expected  range,  specifically  around 
3%  EER. 


ROC  Curve 


Figure  19.  Data-Set  Comparison  with  Expected  Performance 

On  average,  the  Nuance  comparison  data  set  exhibits  an  EER  of  3.4%.  The 
reason  for  the  slight  difference  may  be  explained  by  the  fact  that  the  Phase  Two  test  was 
conducted  within  only  two  weeks  of  the  Phase  One  test,  whereas  in  reality  the  Nuance 
technology  can  verify  voice  signals  recorded  over  a  longer  period  (months  or  years). 
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3.  Comparison  Analysis  (Single  Data-Point  versus  ROC  Curve) 

The  detailed  analysis  by  NPS  resulted  in  a  sub-classification  of  many  rejected 
attempts  as  false  rejections,  incomplete  data  sets,  correct  rejections,  imposter  attempts,  as 
well  as  enrollment  failures.  In  the  context  of  the  single  data-point  analysis,  NPS  defines 
the  total  number  of  valid  verification  attempts  as: 


NT  =  NTAR  +  NFRR  +  NFAR  +  NTFR. 

where, 

NT 

The  total  number  of  valid  verification  attempts 

NTAR 

The  total  number  of  true  accepts 

NFRR 

The  total  number  of  false  rejects 

NFAR 

The  total  number  of  false  accepts 

NTFR 

The  total  number  of  true  failures. 

False  Reject  Rate  (FRR)  =  NFRR  /  NT 

False  Accept  Rate  (FAR)  =  NFAR  /  NT 

Accuracy  of  the  System  =  (  NT  -  (  NFRR  +  NFAR  ) )  /  NT 

=  (  NTAR  +  NTFR  )  /  NT 

Note:  Nuance  presents  only  FRR  and  FAR.  However,  it  is  NPS'  contention  that 
the  accuracy  of  the  system  =  100  -  (FRR+FAR).  See  Table  3  on  the  next  page  for  a 
comparison  of  the  NPS  analysis  versus  the  Nuance  analysis  and  Appendices  C,  D,  and  E 
for  additional  details. 
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DISCUSSION 

ITEM 

NUANCE  ANALYSIS 

NPS  ANALYSIS 

NPS  ANALYSIS 
(EXCLUDES  2  OUTLIERS) 

1.  Enrollment 

Total  Speakers  Enrollment:  71 

Total  Speakers  Enrollment:  68 

Total  Speakers  Enrollment:  66 

Phase  1  (15-24  Apr  05):  54 

Phase  2  (2-8  May  05):  17 

Phase  1  (15-24  Apr  05):  51 

Phase  2  (2-8  May  05):  17 

Phase  1  (15-24  Apr  05):  49 

Phase  2  (2-8  May  05):  17 

Note:  Nuance  considered 
enrollment  data  from  15  Apr  05  to 

8  May  05. 

Note:  NPS  considered  enrollment 
data  from  20  Apr  05  to  8  May  05. 

Note:  Two  high  callers  (outliers) 
were  excluded  from  this  analysis. 

2.  Total  Nbr  of 
Rejected  Calls 

Total  Nbr  of  Rejected  Calls:  46 

(Details  not  provided) 

Total  Nbr  of  Rejected  Calls:  46 

Failure  to  Enroll:  12 

Incomplete  Data:  1 2 

Correct  Rejects:  10 

True  Failures:  12 

Total  Nbr  of  Rejected  Calls:  39 

Failure  to  Enroll:  12 

Incomplete  Data:  10 

Correct  Rejects:  9 

True  Failures:  8 

3.Valid 

Verification 

Attempts 

Valid  Verification  Attempts:  411 

Phase  1 : 204 

Phase  2:  207 

Valid  Verification  Attempts:  411 

Successes:  389 

True  Failures:  12 

Correct  Rejects:  10 

Valid  Verification  Attempts:  336 

Successes:  319 

True  Failures:  8 

Correct  Rejects:  9 

Note:  Identified  by  Phase  only 

Note:  Identified  by  Call  Type 

Note:  Identified  by  Call  Type 

4.  True  Failures 

True  Failures:  7 

True  Failures:  12 

True  Failures:  8 

5.  False 
Acceptance 

(Details  not  provided) 

False  Acceptance:  5 

False  Acceptance:  5 

6.  Accuracy 
Analysis 

Nuance  ROC  Analysis 

FRR  =  3.0% 

FAR  =  3.0% 

Accuracy  =  94.0% 

NPS  Single  Data-point  Analysis 

FRR  =  2.91% 

FAR  =  1.22% 

Accuracy  =  95.87% 

NPS  Single  Data-point  Analysis 

FRR  =  2.38% 

FAR  =  1.48% 

Accuracy  =  96.14% 

This  data  point  is  slightly  better 
than  what  Nuance  expects  their 
system  to  do  on  such  a  test. 

This  data  point  is  slightly  better 
than  what  Nuance  expects  their 
system  to  do  on  such  a  test. 

Nuance  claims: 

For  the  impostor  test,  a  total  of  4,300  trials  matched  against  each  other  and  found  an  EER  of  3%. 

Nuance  claimed  this  is  slightly  better  than  their  average  EER  of  3.4%  over  many  such  data-sets.  For  a  FAR  of  1%,  Nuance 
expects  FRR  of  5%  (system  accuracy  of  94%) 

When  Nuance  repeated  the  ROC  analysis  without  the  user  accounts  with  multiple  enrollments, 

the  EER  remained  the  same. 

Similarly  removing  the  two  most  frequent  speakers  did  not  affect  the  EER  of  the  ROC  analysis 
speakers  did  not  skew  the  results. 

in  other  words,  the  most  frequent 

Note:  Speaker  adaptation  was  not  enabled  during  this  test.  Had  this  been  done,  Nuance  claims  that  the  EER  will  decrease  by 

25%  after  3  calls  resulting  in  a  new  EER  of  1%  or  system  accuracy  of  98%  and  after  6  calls  the  EER  will  be  reduced  by  35%. 

Table  3.  NPS  Speaker  Verification  Test  Analysis  Comparison 
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G.  COMPARISON  WITH  PREVIOUS  SPEAKER  VERIFICATION  TESTS 

USING  NUANCE’S  TECHNOLOGY 

1.  The  University  of  Edinburgh  Speaker  Verification  Test  (May  2000) 

The  UK  Edinburgh  test,  conducted  in  May  2000,  claims  1.2%  half  total  error  rate 
(FRR+FAR/2).  This  corresponds  closely  with  the  NPS  test  with  a  FRR  of  2.7%  at  a  FAR 
of  1%  yielding  a  half  total  error  rate  of  1.85%.  This  difference  can  be  explained  based  on 
the  observations  in  the  Edinburgh  report  reproduced  below  [26]: 

•  The  Edinburgh  test  had  more  enrollment  and  verification  data  (one 
thousand  users)  as  opposed  to  the  NPS  trial  (68  users). 

•  The  Edinburgh  test's  verification  error  rates  were  reduced  by  increasing 
the  amount  of  enrollment  data  used  to  train  the  models  for  each  client 
speaker.  For  example,  training  on  three  utterances  of  a  nine-digit 
membership  number  instead  of  on  a  single  utterance  reduced  the  error  rate 
by  about  one-third  (from  2.7%  to  1.8%  with  both  male  and  female 
impostors,  or  from  3.5%  to  2.4%  with  same-sex  impostors);  comparable 
improvements  were  obtained  on  other  verification  phrases. 

•  The  Edinburgh  test  used  multiple  digit  phrases  (a  nine-digit  account 
number,  an  eight-digit  membership  number  and  two  single  digits)  yielding 
an  error  rate  of  1.2%  with  both  male  and  female  impostors  or  1.4%  with 
same-sex  impostors,  with  speaker  models  trained  on  three  enrollment 
utterances  per  phrase. 

•  The  great  majority  of  the  calls  made  to  the  Edinburgh  speaker  verification 
system  were  made  from  landline  telephones,  usually  at  the  participants’ 
workplaces  or  homes. 
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2.  The  International  Biometrics  Group  (IBG)  Test  (2004) 

The  IBG  test  reports  a  worst-case  estimate  of  a  FAR  of  0.818%  versus  an  FRR  of 
1.04%  for  landline  calls  and  a  FAR  of  2.0%  versus  a  FRR  of  2.27%  for  cellular  calls. 
This  was  on  a  database  of  200  callers  and  the  estimates  on  a  second  visit  after  a  period  of 
4  to  5  weeks  (test  results  provided  by  Nuance)  [27]  [28]. 

•  Testing  occurred  in  a  sterile  environment.  The  room  was  reasonably 
isolated  from  external  noise.  A  manually  adjustable  thermostat  controlled 
the  room's  air  conditioning.  Air  conditioning  was  set  to  "off"  during 
testing,  as  the  climate  control  fans  were  sufficiently  loud  to  potentially 
impact  testing  if  they  had  engaged. 

•  IBG  used  completely  matched  handsets.  Landline  testing  took  place 
through  an  AT&T  Trimline  Caller  ID  Telephone  Model  260.  Cellular 
phone  testing  took  place  on  a  Samsung  S105. 

•  IBG  also  used  three  utterances  of  16-digits  for  both  enrollment  and 
verification.  (The  NPS  test  used  three  utterances  of  9-digits  for  enrollment 
and  two  utterances  of  9-digits  for  verification.) 

H.  TEST  LIMITATIONS 

For  purposes  of  this  test,  participants  were  expected  to  be  who  they  claimed  to  be 
and  hence  no  separate  and  independent  identity  checks  were  planned,  either  during  or 
prior  to  enrollment.  Furthermore,  in  this  test,  NPS  did  not  keep  records  of  the  type  of 
phone  lines  used,  e.g.,  whether  calls  were  received  from  landline  or  cell  phone.  NPS 
expected  to  have  a  random  mix  of  the  two. 

Another  variable  of  this  test  was  the  number  of  test  subjects.  The  total  number  of 
speaker  enrollments  was  68  speakers;  however,  only  64  out  of  the  68  speakers  who 
initially  enrolled  made  subsequent  calls  to  the  system  to  verify  their  voice  biometrics  (It 
would  have  been  preferable  to  have  at  least  a  100  enrollments  and  at  least  a  thousand 
speaker  verification  attempts). 
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Given  the  limited  scope  of  this  test,  gauging  how  the  error  rates  will  scale  up  for 
the  speaker  verification  technology  as  the  background  database  grows  is  difficult.  No 
statistics  are  available  for  speaker  verification  against  very  large  voice  background 
databases.  Nor  it  is  clear  what  the  error  rates  and  accuracy  would  be  for  the  Arabic 
speaker  verification  system.  NPS  can  only  say  that  the  Arabic  speaker  verification 
accuracy  would  be  no  higher  than  that  for  the  English  speaker  verification  module. 
Nuance  has  13  million  English  voice  models  in  its  database  and  continues  to  fine-tune 
speaker  verification  performance  as  new  data  are  collected.  Presently,  they  have  no 
Arabic  voice  models  in  its  database  system  for  fine-tuning  purposes. 

I.  PHASE  IB  SUMMARY 

In  Phase  IB  of  this  project,  NPS  successfully  conducted  a  speaker  verification  test 
to  assess  Nuance’s  speaker  verification  technology  based  on  the  performance  measures  of 
the  FRR  and  FAR.  During  the  test,  NPS  did  not  impose  any  restrictions  on  the  callers  in 
terms  of  the  type  of  phone  used  or  from  where  the  calls  originated.  And  while  the 
Nuance  ROC  analysis  yields  an  equal  error  rate  of  3%  (FRR  based  on  411  trials,  FAR 
based  on  4300  trials)  and  a  system  accuracy  of  94%,  the  NPS  analysis  yields  a  FRR  of 
2.91%  and  a  FAR  of  1.2%  (based  on  411  verification  attempts)  and  a  system  accuracy  of 
95.87%.  The  ROC  analysis  equal  error  estimates  of  the  NPS  test  are  in  the  same  range  as 
the  average  estimates  of  the  equal  error  rate  (FRR  =  3.4%,  FAR  =  3.4%  and  system 
accuracy  =  93.2%)  by  Nuance  based  on  other  similar  datasets.  This  validates  the  NPS 
test  in  spite  of  the  smaller  number  of  enrollments  and  speaker  verification  attempts. 
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VI.  CONCLUSIONS 


A.  SUMMARY  DISCUSSION 

Speaker  verification  is  a  viable  form  of  biometric  technology  and  merits  further 
research.  In  terms  of  perceived  applications  for  operations  in  Iraq,  voice  biometrics 
offers  unique  capabilities  that  are  unmatched  in  terms  of  remote-ability,  flexibility, 
maintenance  and  cost.  First,  voice  biometrics  uses  existing  telecommunication 
infrastructures  (landline,  cellular  or  VoIP),  as  such,  a  new  infrastructure  is  not  required  to 
be  built  around  the  deployment/employment  of  this  technology,  which  reduces  costs  and 
time  to  deploy  the  technology.  Second,  voice  biometrics  allows  dissemination  and 
collection  of  information  other  than  key  biometric  data.  Third,  voice  biometrics  can  be 
employed  in  multilingual  applications  without  the  aid  of  a  trained  linguist  or  a  translator, 
which  results  in  manpower  savings.  And  fourth,  voice  biometrics  rely  on  a  signal  that  is 
natural  and  unobtrusive  to  produce  and  requires  no  special  user  equipment  or  training, 
which  results  in  the  rapid  deployment  of  technology  without  adding  additional  training 
requirements  for  troops  serving  in  Iraq  and  Iraqi  citizens. 

This  thesis  has  documented  the  results  of  the  NPS  research  team’s  efforts  on  the 
initial  phase  of  the  IEVAP.  The  intent  of  this  project  was  to  contribute  to  the  future 
employment  of  speech  technologies  in  a  variety  of  coalition  military  operations  by 
developing  a  pilot  POC  system  that  integrates  COTS  speaker  verification  and  ASR 
technologies  into  a  mobile  platform  to  enhance  warfighting  capabilities. 

In  Phase  1A  of  the  IEVAP,  NPS  successfully  developed  a  bilingual  (English  and 
Jordanian-Arabic)  speech  application  that  demonstrated  the  viability  of  speaker 
verification  technology  for  use  in  operations  in  Iraq. 

In  Phase  IB  of  the  IEVAP,  NPS  successfully  conducted  a  test  to  assess  the 
accuracy  claim  of  Nuance's  packaged  speaker-verification  application,  Nuance  Caller 
Authentication  1.0  (for  North  American  English).  The  NPS  test  consisted  of  68  speaker 
enrollments  and  411  speaker  verification  attempts.  Upon  completion  of  the  test,  NPS 
conducted  a  single  data-point  analysis  yielding  a  system  accuracy  of  95.87%. 
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B.  RECOMMENDATIONS  FOR  FURTHER  RESEARCH 


As  the  preliminary  phase  of  the  IEVAP  comes  to  a  completion,  it  is  evident  that 
the  objectives  for  Phase  1A  and  IB  of  the  IEVAP  have  been  accomplished.  However, 
further  research  is  required  to  achieve  the  main  objective  of  the  IEVAP,  which  is  to 
develop  and  demonstrate  a  speaker  verification  system  in  Iraqi- Arabic.  The  following  is 
a  list  of  recommended  further  studies  for  NPS  students  in  support  of  this  research  project. 

•  Develop  a  test  to  assess  the  performance  of  the  Iraqi-Arabic  speaker 
verification  and  speech  recognition  language  modules  for  Phase  1C  of  the 
IEVAP. 

•  Conduct  a  cost-benefit  analysis  on  the  deployment  of  speaker  verification 
technology  in  Iraq. 

•  Conduct  a  comparative  analysis  on  the  communication  infrastructure  of 
Iraq,  e.g.,  comparison  of  802.11,  802.16,  cellular,  and  landline 
technologies  in  support  of  the  employment  of  speaker  verification 
technology  in  Iraq. 
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APPENDIX  A.  BCCF  DIALOG  SPECIFICATION 


NAVAL 

POSTGRADUATE 

SCHOOL 

MONTEREY,  CALIFORNIA 

DIALOG  SPECIFICATION 


BAGHDAD  CENTRAL  CORRECTION  FACILITY  (BCCF) 
VISITOR  CENTER  APPLICATION 

APPLICATION  VERSION  1.0 

by 

Samuel  K.  Lee 
June  2005 


Dialog  Development  Support:  Shamitha  Somashekar  (Nuance) 

Technical  Support:  Torsten  Zeppenfeld  (Nuance) 

Technical  Support:  Ralf  Schiffert  (Nuance) 

Linguistic  Support:  Motasem  Mansi  (DLI) 
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A. 


BILINGUAL  BCCF  APPLICATION  OVERVIEW 


1.  Revision  History 

This  dialog  specification  document  is  produced  and  controlled  by  the  Naval 
Postgraduate  School.  All  requests  to  make  changes  to  this  document  should  be  directed 
to  the  authors  so  that  changes  are  made  through  the  appropriate  version  control 
procedures. 

2.  Typographical  Conventions 

•  Prompt  text  in  sample  dialogs  is  within  quotes  and  bold  (e.g.,  "May  I  help 
you?") 

•  Verbal  responses  from  the  user  and  sample  phrases  are  within  quotes  (e.g., 
"Yes.") 

•  Natural  language  (NL)  slots  are  bold  and  between  angle  brackets  (e.g., 
<name>).  NL  slots,  which  are  determined  by  the  grammar  being  used,  are 
filled  with  values  based  on  what  the  user  has  said.  Sometimes  the  values 
of  NL  slots  are  stored  in  system  variables  for  later  use. 

•  Text-to-speech  (TTS)  output  is  shown  in  Italics  (e.g.,  Say-as  expr:  name.) 
If  the  TTS  value  is  a  literal,  it  is  also  placed  in  quotes  (e.g.,  TTS:  "The 
date  I  heard  was.") 

3.  Dialog  State  Format 

A  dialog  state  represents  one  conversational  interchange  between  the  system  and 
the  user.  Dialog  states  may  contain  the  following  elements: 

•  Description:  Explains  what  interaction  takes  place  in  the  dialog  state. 

•  Special  Features:  Describes  relevant  special  features,  such  as  whether  N- 
best  processing  is  used  or  the  state  is  a  hot-word  state  and  any  universal 
behavior  (whether  there  are  exceptions,  etc.). 

•  Entry  and  Exit  States:  Lists  (as  links)  the  possible  preceding  and  following 
dialog  states. 
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•  Pre-rec  Prompts:  Lists  the  prompts  that  may  be  played  prior  to  receiving 
the  user’s  input. 

•  Grammar:  In  a  recognition  state,  defines  the  grammar  used  for  recognizing 
the  user’s  input  by  showing  slot  names  and  values.  Also  shows  sample 
phrases  that  fill  the  NL  slots.  The  "Sample  Phrases"  list  is  not  exhaustive. 

•  Actions:  Lists  the  actions  to  be  taken  by  the  system  (typically  based  on 
system  variable  values). 

•  Error  Behaviors:  If  an  error  behavior  for  a  dialog  state  differs  from  the 
application-level  behavior,  it  is  noted  in  this  section. 

•  State-Specific  Universal  Behaviors:  If  a  universal  behavior  (e.g.,  help)  for 
a  dialog  state  differs  from  the  application-level  behavior,  it  is  noted  in  this 
section. 

B.  BILINGUAL  BCCF  APPLICATION  SUMMARY 
1.  Functionality  and  Features 

Automated  Speech  Recognition  (ASR)  application  in  support  of  the  voice- 
activated  menu-driven  application  for  the  Baghdad  Central  Correctional  Facility  (BCCF). 

a.  DTMF 

Where  applicable,  callers  can  use  DTMF  (touch-tone)  to  enter  such 
information  as  phone  numbers,  PINs,  dates,  and  monetary  amounts. 

b.  Text-to-Speech  Output 

Text-to-speech  output  is  used  in  the  application,  if  needed. 

c.  N-Best/Skiplists 

The  N-best  list  is  where  the  recognizer  stores  not  only  the  result  that  has 

the  highest  probability  but  also  N  other  results  in  order  of  decreasing  probability.  To 

avoid  caller  frustration  and  to  get  more  calls  put  through  successfully,  the  application 

implements  a  “skip  list.”  Skip  lists  are  used  in  combination  with  N-best  lists  and  store 

items  that  have  been  negatively  confirmed  by  the  caller.  When  the  caller  is  re-prompted 

in  the  same  state,  items  in  the  N-best  list  that  are  present  in  the  skip  list  are  discarded  and 
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the  application  skips  over  to  the  next  result  on  the  list.  If  all  the  results  in  the  N-best  list 
are  on  the  skip  list,  the  top  choice  on  the  N-best  list  should  be  selected. 

N-best  lists  are  also  used  in  conjunction  with  checksum  algorithms  (e.g., 
for  credit  card  numbers)  and  other  data  sources  (e.g.,  customer  databases).  Cross- 
referencing  the  N-best  results  allows  the  application  to  eliminate  incorrect  recognition 
hypotheses.  This  technique  is  often  combined  with  a  skip  list. 

d.  Filler  -  prefixes,  suffixes 

Fillers  are  incorporated  in  the  grammar  before  (prefix)  and  after  (suffix) 
the  meaningful  portion  of  the  sentence.  Examples  of  fillers  are:  "I  want  to,"  "I  want," 
"please,"  "uh,"  and  "urn." 

e.  Barge-in 

Barge-in  is  the  ability  of  the  system  to  recognize  that  a  caller  is  speaking 
while  a  prompt  is  still  playing,  and  to  stop  playing  the  prompt.  Barge-in  enables  faster 
service  for  experienced  callers  who  can  interrupt  prompts,  quickly  going  through  the 
dialog.  Less-experienced  callers  are  still  guided  by  full  prompts. 

/.  Randomization  of  prompts 

Certain  prompts  that  are  heard  over  and  over  again  may  have  variations 
that  are  played  randomly.  For  example,  the  confirmation  "okay"  might  be  randomly 
varied  with  "sure"  and  "got  it."  This  makes  the  system  more  conversational  and  natural. 

g.  Non-recognition  States 

Non-recognition  states  are  used  mainly  in  cases  where  the  system  needs  to 
do  data  processing,  such  as  sending  or  retrieving  information  from  the  back-end. 
Sometimes  these  states  will  also  include  brief  informational  prompts  that  are  played  back 
to  the  caller,  such  as  “Sorry,  but  I  was  not  able  to  complete  your  request.  Now,  hold  on 
and  I’ll  take  you  back  to  the  Main  Menu.” 

In  non-rec  states,  barge-in  is  off,  which  means  that  if  a  caller  says 
something  during  this  state,  nothing  will  happen.  Barge-in  will  be  turned  back  on  when 
the  caller  reaches  the  next  state. 
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h.  Task  Completion  Tags 

For  VoiceXML  applications,  to  add  more  accurate  reporting,  tasks  can  be 
labeled  with  task  completion  tags  in  the  code  to  signify  a  task  start  and  a  task  end.  Where 
appropriate,  task  completion  tags  are  noted  in  the  dialog  spec  to  be  added  to  the  code. 
For  example,  an  end  tag  might  look  like  this: 

<nuance:taskend  name=”accountbalance”  cond=  “true”/> 

It  is  important  to  be  careful  with  tags  in  the  case  of  factors  like  “repeat”  or 
switching  between  sub-applications,  to  make  sure  the  taskbegin  and  taskend  tags  match 
up  correctly. 

In  addition,  states  in  which  a  task  has  already  been  completed  (and  no  new 
task  has  been  started)  should  override  the  max  error  and  universals  to  make  sure  a  task 
end  tag  is  not  written,  to  avoid  mis-matched  tags. 

i.  Hot-word 

Hot-word  states  are  used  in  cases  where  the  system  is  not  expecting  the 
caller  to  say  something  in  response  to  a  prompt,  but  instead  is  playing  back  information 
to  a  caller.  Examples  of  this  include  implicit  confirmation  (”Okay,  fifty  dollars.”)  or 
general  information  playback  (”The  phone  number  is:  604  555  1234,  and  the  amount 
owed  is  fifty-six  dollars.”)  However,  rather  than  make  these  non-recognition  states,  hot- 
word  allows  the  callers  to  say  a  small  subset  of  things,  such  as  “no!”  or  “repeat,”  which 
gives  the  dialog  more  flexibility. 

In  a  hot-word  state,  the  prompt  is  only  cut  off  if  the  user  says  something 
within  grammar.  All  out  of  grammar  utterances  are  ignored  and  the  prompt  continues 
playing  as  if  the  caller  had  not  said  anything. 

Hot-word  states  generally  have  small  grammars,  such  as  just  the 

universals. 

j.  VoiceXML  Grammar  Labels 

A  grammar  label  is  automatically  included  for  each  state.  Grammar  labels 
are  essential  for  efficient  system  tuning. 
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2. 


Users 


It  is  assumed  that  the  visitors  of  detainees  are  between  the  ages  of  18  and  50. 
They  consist  mostly  of  family  members  of  the  detainees,  often  wives,  children,  mother, 
and  fathers.  It  is  assumed  that  the  visitors  are  generally  repeat  visitors.  It  is  also  assumed 
that  visitors  are  unfamiliar  with  the  use  of  speaker  verification  and  ASR  technology 

3.  Persona 

This  is  an  official  Department  of  Defense  (DoD)  system;  as  such  a  persona  of 
professionalism  is  required.  However  special  attention  must  be  given  to  the  fact  that  the 
majority  of  Callers  to  this  system  will  be  the  family  members  of  the  Detainees,  therefore, 
careful  consideration  of  their  culture  and  customs  is  also  a  necessity.  Additionally,  as 
with  existing  US  Correction  Facility  visitation  information  system,  Callers  of  this  system 
are  expected  to  request  directions  to  the  detention  facility  and  will  request  visitation 
information,  such  as  hour  of  operations  or  general  visitation  procedures. 

4.  Variable  Definitions 

There  are  no  variables  set  in  this  application. 

C.  BILINGUAU  BCCF  APPLICATION  DIALOG  FLOW 

1.  Universal  Behaviors 

Certain  capabilities  and  behaviors  are  available  in  all  dialog  states,  unless 
otherwise  specified.  These  are  called  "Universals." 
a.  Universal  Actions 

The  "Universal  Actions"  grammar  is  active  in  all  states  that  have 
recognition.  This  grammar  is  typically  used  to  allow  callers  to  ask  for  help,  repeat 
prompts,  or  transfer  to  an  operator.  Examples  of  expressions  and  corresponding  universal 
NL  slot  fill  values  are  shown  in  the  table  below.  The  following  table  shows  the 
universals  available  with  the  Nuance  Voice  Platform.  These  are  not  necessarily  active  in 
this  application. 
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Universal  Values 

Sample  Phrases 

cancel 

’cancel’ 

’go  back’ 

exit 

’exit’ 

’goodbye’ 

help 

’help’ 

’I  need  help’ 

mainmenu 

’main  menu’ 

’  start  over’ 

operator 

’Service  Representative’ 

’I  want  to  talk  with  an  operator’ 

’agent’ 

repeat 

’repeat’ 

The  following  table  shows  the  universal  behaviors  specified  in  this  application. 


Universal  Type 

Action 

Goto 

help 

Okay,  here’s  some  help. 

Continue  with  recognition  in 

the  state  in  which  the 

Details: 

help_universal  “Okay,  here’s  some 

help.” 

universal  was  spoken. 

repeat 

Continue  with  recognition  in 

AND  (_previousBehavior  == 

the  state  in  which  the 

undefined) 

universal  was  spoken. 

repeat 

Throw  the  event: 

AND  (_previousBehavior  != 

undefined) 

_previousBehavior 

operator 

I’m  sorry,  there  are  no  representatives 

Continue  with  recognition  in 

available. 

the  state  in  which  the 
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Details: 

operator_universal  “I’m  sorry,  there  are 

no  representatives  available.” 

universal  was  spoken. 

exit 

CleanUpAndExitEnglish#say 

Goodbye 

mainmenu 

OK,  Let’ s  start  over. 

Details: 

mainmenu_universal  “OK,  Let’s  start 

over.” 

LanguageSelection#Language 

Selection 

b.  Universal  Error  Handling 

Universal  error  handling  is  outlined  below.  This  error  behavior  can  be 
overridden  in  any  given  state. 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Sorry. 

Details: 

global_errorl  “Sorry.” 

Continue  with  state- specific 

behavior. 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Sorry,  I  still  didn’t  get  that. 

Details: 

global_error2  “Sorry,  I  still  didn’t  get 

that.” 

Continue  with  state- specific 

behavior. 

WHEN ( COUNT  =  3 ) 

nomatch  noinput 

maxspeechtimeout 

Sorry,  we’re  experiencing  some 

technical  difficulty  right  now.  Please  try 

again  at  a  later  time. 

CleanUpAndExitEnglish#say 

Goodbye 

Details: 

global_error3  “Sorry,  we’re 
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experiencing  some  technical  difficulty 
right  now.  Please  try  again  at  a  later 
time.” 


D.  BILINGUAL  BCCF  APPLICATION  DIALOG  STATES 

This  section  provides  details  of  the  system  behavior  in  each  dialog  state. 

1.  WelcomeBCCF  Page  Information 

a.  Description 

Start  page  for  Baghdad  Central  Correctional  Facility  (BCCF)  Visitor 
Center  Application. 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 

c.  Call  Flow 


2.  W  elcomeB  C  CF#W  elcomeB  C  CF 

a.  Description 
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Plays  welcome  prompt  to  the  Baghdad  Central  Correctional  Facility’s 
Visitor  Center.  (This  is  a  non-recognition  processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

- 

LanguageSelection#LanguageSelection 

d.  Actions 


Condition 

Action 

Goto 

Hi,  Welcome  to  Baghdad  Central  Correctional  Facility’s 

Visitor  Center.  Hi,  Welcome  to  Baghdad  Central 

Correctional  Facility’s  Visitor  Center. 

FanguageSelection#Fangu 

ageSelection 

Details: 

WelcomeBCCF_English  “Hi,  Welcome  to  Baghdad  Central 

Correctional  Facility’s  Visitor  Center.” 

WelcomeBCCF_Arabic  “Hi,  Welcome  to  Baghdad  Central 

Correctional  Facility’s  Visitor  Center.” 

3.  LanguageSelection  Page  Information 

a.  Description 

Language  selection  page,  allows  callers  to  continue  in  either  English  or  in 
Jordanian- Arabic . 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 
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c. 


Call  Flow 


4.  LanguageSelection#LanguageSelection 

a.  Description 

Prompts  users  to  select  a  language:  English  or  Arabic.  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

WelcomeBCCF#WelcomeBCCF 

FanguageS  election#EngMainMenu 

FanguageS  election#ArabMainMenu 

d. 


Pre-rec  Prompts 
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Type  and  Condition 

Action 

Entry  Type  =  initial 

To  continue  in  English,  say  ‘English’.  To  continue  in  Arabic,  say 

‘Arabic’ . 

Details: 

LanguageSelection_initEng  “To  continue  in  English,  say  ‘English’.” 

LanguageSelection_initArab  “To  continue  in  Arabic,  say  ‘Arabic’.” 

e.  Grammar:  LanguageSelection_LanguageSelection.gsl 


NL  Slots 

V  alues 

<language> 

english,  arabic 

Sample  Phrases 

Slots  Filled 

’’english” 

<language  english> 

”i’d  like  to  continue  in  english” 

<language  english> 

’’continue  in  english” 

<language  english> 

”uh  english” 

<language  english> 

’’arabic” 

<language  arabic> 

”uh  arabic” 

<language  arabic> 

’’continue  in  arabic” 

<language  arabic> 

”i’d  like  to  continue  in  arabic” 

<language  arabic> 

’’araabic” 

<language  arabic> 

’’arabik” 

<language  arabic> 

’’araabik” 

<language  arabic> 

’’arabia” 

<language  arabic> 

’’araabia” 

<language  arabic> 

’’arabee” 

<language  arabic> 

’’araabee” 

<language  arabic> 

’’araabeah” 

<language  arabic> 
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”el  arabic” 

<language  arabio 

”el  araabik” 

<language  arabio 

”el  araabia” 

<language  arabio 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  la 

Thanks. 

LanguageSelection#EngM 

nguage  ==  “english” 

Details: 

Generic_thanks  “Thanks.” 

ainMenu 

lastresult$ .  interpretation,  la 

Thanks. 

LanguageSelection#Arab 

nguage  ==  “arabic” 

Details: 

Generic_thanksArabic  “Thanks." 

MainMenu 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 

1) 

nomatch  noinput 

maxspeechtimeout 

Please  select  a  language.  [50msecs]  Please  select  a  language. 

[50msecs]  To  continue  in  English,  say  ‘English’.  [50msecs] 

To  continue  in  Arabic,  say  ‘Arabic’. 

Details: 

LanguageSelection_errorEnglish  “Please  select  a  language.” 

Silence:  50  msecs 

Languages election_error Arabic  “Please  select  a  language.” 

Silence:  50  msecs 

Languages  election_initEng  “To  continue  in  English,  say 

‘English’.” 

Silence:  50  msecs 

Languages election_init Arab  “To  continue  in  Arabic,  say 

‘Arabic’.” 

Continue  with  rec  in 

this  state. 
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WHEN ( COUNT  = 
2) 

nomatch  noinput 
maxspeechtimeout 


Please  select  a  language.  [50msecs]  Please  select  a  language.  Continue  with  rec  in 
[50msecs]  To  continue  in  English,  say  ‘English’.  [50msecs]  this  state. 

To  continue  in  Arabic,  say  ‘Arabic’. 


Details: 

LanguageSelection_errorEnglish  “Please  select  a  language.” 
Silence:  50  msecs 

Languages election_error Arabic  “Please  select  a  language.” 
Silence:  50  msecs 

Languages  election_initEng  “To  continue  in  English,  say 
‘English’.” 

Silence:  50  msecs 

Languages election_init Arab  “To  continue  in  Arabic,  say 
‘Arabic’.” 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

With  this  system,  you  have  the  option  to  continue  in 

Continue  with  rec  in  this 

either  English  or  in  Arabic.  With  this  system,  you  have 

the  option  to  proceed  in  either  English  or  in  Arabic.  To 

continue  in  English,  say  ‘English’.  To  continue  in 

Arabic,  say  ‘Arabic’. 

state. 

Details: 

LanguageSelection_helpEnglish  “With  this  system, 

you  have  the  option  to  continue  in  either  English  or  in 

Arabic.” 

LanguageSelection_helpArabic  “With  this  system, 

you  have  the  option  to  proceed  in  either  English  or  in 

Arabic.” 

LanguageSelection_initEng  “To  continue  in  English, 

say  ‘English’.” 

LanguageSelection_initArab  “To  continue  in  Arabic, 

say  ‘Arabic’.” 
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5. 


LanguageSelection#ArabMainMenu 


a.  Description 

Link  to  Arabic  Main  Menu  (This  is  a  subdialog  calling  the 

ArabicMainMenusubdialog) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

LanguageSelection#LanguageSelection 

- 

d.  Actions 


Condition 

Action 

Goto 

- 

e.  Inputs  to  the  Subdialog 


Name 

Value 

DATE_OUT_day 

DATE_OUT_month 

DATE_OUT_year 

TIME_OUT_AM_PM 

TIME_OUT_time 

accountNbr 

enrollmentPin 

6.  LanguageSelection#EngMainMenu 
a.  Description 
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Link  to  English  Main  Menu  (This  is  a  subdialog  calling  the 
EngMainMenusubdialog) 

b.  Special  Features 

d.  Entry  and  Exit  States 


Entry  States 

Exit  States 

LanguageSelection#LanguageSelection 

CleanUpAndExitEnglish#sayGoodbye 

e.  Actions 


Condition 

Action 

Goto 

- 

CleanUpAndExitEnglish#sayGoodbye 

f  Inputs  to  the  Subdialog 


Name 

Value 

DATE_OUT_day 

DATE_OUT_month 

DATE_OUT_year 

TIME_OUT_AM_PM 

TIME_OUT_time 

accountNbr 

enrollmentPin 

7.  CleanUpAndExitEnglish  Page  Information 

a.  Description 

Clean  up  and  exit  in  English 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 
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c. 


Call  Flow 


8.  CleanUpAndExitEnglish#sayGoodbye 

a.  Description 


(This  is  a  non-recognition  processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

Languages  election#EngMainMenu 

CleanUpAndExitEnglish#hangup 

d.  Actions 


Condition 

Action 

Goto 

Details: 

CleanUpAndExit_sayGoodbyeEnglish 

CleanUpAndExitEnglish# 

hangup 

9.  CleanUpAndExitEnglish#hangup 
a.  Description 


(This  is  a  terminate  state.) 
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b.  Special  Features 


c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

CleanUpAndExitEnglish#sayGoodbye 

- 

E.  BILINGUAL  BCCF  APPENDICES 


1.  Grammar  and  Slot  Definitions 


Dialog  State 

Grammar 

Slots 

Slot  Values 

Languages  election#Languag 

eS  election 

LanguageSelection_Languag 

eSelection.gsl 

language 

english,  arabic, 

2.  Prompt  List 


Prompt  File 

Transcription 

help_universal 

’’Okay,  here’s  some  help.” 

operator_universal 

”I’m  sorry,  there  are  no  representatives  available.” 

mainmenu_universal 

”OK,  Let’s  start  over.” 

global_errorl 

’’Sorry.” 

global_error2 

’’Sorry,  I  still  didn’t  get  that.” 

global_error3 

’’Sorry,  we’re  experiencing  some  technical  difficulty  right 

now.  Please  try  again  at  a  later  time.” 

Generic_thanks 

’’Thanks.” 

Generic_thanks  Arabic 

’’Thanks.” 

CleanUpAndExit_sayGoodbyeEnglish 

WelcomeBCCF_English 

”Hi,  Welcome  to  Baghdad  Central  Correctional  Facility’s 

Visitor  Center.” 

WelcomeBCCF_Arabic 

”Hi,  Welcome  to  Baghdad  Central  Correctional  Facility’s 

Visitor  Center.” 
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Languages  election_initEng 

”To  continue  in  English,  say  ‘English’.” 

Languages  election_init  Arab 

”To  continue  in  Arabic,  say  ‘Arabic’.” 

LanguageSelection_helpEnglish 

’’With  this  system,  you  have  the  option  to  continue  in 

either  English  or  in  Arabic.” 

Languages  election_help  Arabic 

’’With  this  system,  you  have  the  option  to  proceed  in 

either  English  or  in  Arabic.” 

LanguageSelection_errorEnglish 

’’Please  select  a  language.” 

Languages  election_error  Arabic 

’’Please  select  a  language.” 

F.  ARABI CM AINMENU  OVERVIEW 


1.  Application  Summary 

a.  Variable  Definitions 

Application  variable  information  is  listed  below  (if  available). 


Application  Variables  Table 

Name 

Initial  Value 

Description 

accountNbr 

another  sample  variable  for  the  subdialog 

enrollmentPin 

DATE_OUT_day 

DATE_OUT_month 

DATE_OUT_year 

TIME_OUT_AM_PM 

TIME_OUT_time 

2.  Dialog  Flow 

a.  Universal  Behaviors 

Certain  capabilities  and  behaviors  are  available  in  all  dialog  states,  unless 
otherwise  specified.  These  are  called  ‘Universals.’ 

b.  Universal  Actions 
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The  ‘Universal  Actions’  grammar  is  active  in  all  states  that  have 
recognition.  This  grammar  is  typically  used  to  allow  callers  to  ask  for  help,  repeat 
prompts,  or  transfer  to  an  operator.  Examples  of  expressions  and  corresponding  universal 
NL  slot  fill  values  are  shown  in  the  table  below.  The  following  table  shows  the  universals 
available  with  the  Nuance  Voice  Platform.  These  aren’t  necessarily  active  in  this 
application. 


Universal  Values 

Sample  Phrases 

cancel 

’cancel’  ’go  back' 

exit 

’exit’  ’goodbye’ 

help 

’help’  ’I  need  help’ 

mainmenu 

’main  menu’  ’start  over’ 

operator 

’Service  Representative’ 

’I  want  to  talk  with  an  operator’  ’agent' 

repeat 

’repeat’ 

The  following  table  shows  the  universal  behaviors  specified  in  this  application. 


Universal  Type 

Action 

Goto 

help 

Continue  with  recognition  in 

the  state  in  which  the 

Details: 

help_universal  A?  1 ' 

universal  was  spoken. 

repeat 

Continue  with  recognition  in 

AND  (_previousBehavior  == 

the  state  in  which  the 

undefined) 

universal  was  spoken. 

repeat 

Throw  the  event: 

AND  (_previousBehavior  != 

undefined) 

_previousBehavior 
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operator 

Jjjr  J  ^  J. JS-U  J  J' 

CleanUpAndexit_sayGoodby 

Cxs 

eArabic#sayGoodbye 

Details: 

operator_universal  JjMii  «■'£  J*dl“ 

Cxs oi/d-W  j 

exit 

CleanUpAndexit_sayGoodby 

eArabic#sayGoodbye 

mainmenu 

ArabicMainMenu#ArabicMai 

nMenu 

c.  Universal  Error  Handling 

Universal  error  handling  is  outlined  below.  This  error  behavior  can  be 
overriden  in  any  given  state. 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Details: 

globaLerrorT’MijJ  'u'“ 

Continue  with  state- specific 

behavior. 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Details: 

global_error2i  U  '<j'“ 

Continue  with  state- specific 

behavior. 

WHEN ( COUNT  =  3 ) 

nomatch  noinput 

maxspeechtimeout 

^UU  Ml>“'  '<j' 

<j'  jo 

. J^IJ  ,Oj jj  (_5* — a  1  jj jl^Cj 

CleanUpAndexit_sayGoodby 

eArabic#sayGoodbye 

Details: 

global_error3LS  'u'“  »£t  jj  'uu1  1  j-m 
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.MJJ  '(!£(»  ' jJ j'c1-1 


G.  ARABI CM AINMENU  DIALOG  STATES 

This  section  provides  details  of  the  system  behavior  in  each  dialog  state. 

1.  ArabicMainMenu  Page  Information 

a.  Description 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 

c.  Call  Flow 
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2.  ArabicMainMenu#ArabicMainMenu 

a.  Description 

Arabic  Main  Menu,  enables  callers  to  get  visitation  information,  get 
directions  to  BCCF,  and  use  automated  scheduling  system.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicMainMenu#ArabicVisitInformation 

ArabicMainMenu#ArabicDirections 

ArabicMainMenu#ArabicVisitInformation 

ArabicMainMenu#ArabicDirections 

ArabicScheduling#ArabicScheduling 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

cj If  csdg;  d 2d  :si/dtOoJI  j'(/£d'  Of  AoAt'd'  « jd' 

ijiS A3  o<-« j£f  jj  lil  1^1  “  Jjtjj  «.l^ jjli—s  io jl(_s  jd^ 

d'f&AAd  ijij jla“  Jj(j  jjtl-j  1  djlj-i’jjl 

,”J£jf  di^o31— djij  jdl‘-s‘Lsd'd'  dL5^(_>“— ‘d'  fd=><j 

Details: 

ArabicMainMenu_init  djo^cdd  :ocsJlcjJI ^ Ao^dl  Of  Ao^c'd'  jd'“ 

fCj(jil  lil  “  Jjj  10 jl(_5 jjl<— i  Cj^jd^f  (_sJ^ 

,”d. JO-3  jd'  As A3*1  djij  dj  jJ'i-a  l(j£.l3Jf  lid' d JO-3  jdl  (JlS A3  3l-i j£f  OJ  J J1-^ 

^ jdli-iiLsd'd'  dcSJo-'-Aj'  f D=>(_j  d'f^Oj^lJ  Jj(_3  0 

e.  Grammar: 

ArabicMainMenu_ArabicMainMenu.gsl#Sample_Rule 


NL  Slots 

V  alues 

<userlnput> 

information,  directions,  scheduling 

Sample  Phrases 

Slots  Filled 
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<userlnput  information> 

jd^f  sC%_  3 

<userlnput  information> 

”^lp. <-s3^  J jo-^C 3'  A?  J” 

<userlnput  information> 

”  J 30^ j3'  As  j^>” 

<userlnput  directions> 

” J 30^ j3'  As A*  s,-i jgy 

<userlnput  directions> 

” J jij-3 jJI  JlS j^>  ls3j;  J joa^3'  AS j'” 

<userlnput  directions> 

3lS£l>“-j” 

<userlnput  scheduling> 

3l££l>*^  AS J” 

<userlnput  scheduling> 

”lSlM  AS£.'j(hJ  A? J'” 

<userlnput  scheduling> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

(J6 

ArabicMainMenu#  Arabic 

serlnput  ==  "information” 

Details: 

Generic_sure^i»  AAj'  3°“ 

Visitlnformation 

lastresult$ .  interpretations 

ArabicMainMenu#  Arabic 

serlnput  ==  "directions” 

Details: 

Generic_sure”?<jj-^'i»  3»“ 

Directions 

lastresult$ .  interpretations 

Ja 

ArabicScheduling#  Arabic 

serlnput  ==  “scheduling” 

Details: 

GeneriC-Sure’Tuj-^'i1  e^u'  3»“ 

Scheduling 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

lio  i_sJI  is  jfa  isA^_  (jjJjCj 1  Jo 

Continue  with  rec  in 

nomatch 

noinput 

lsJj;  V3'3'  As^o^^A  f“3=C  ^iijf>3' 

this  state. 
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maxspeechtimeout 

JjO^JJ  a‘-r10*OJ',-r1  :Jj(J  e'^jJ'  ‘^a'fjJ^ 

Jjl3  HjrjJli-i  lsJ'  JjiJ-^jJ'  JlS CJ£_  ‘-JV-sJ£i“: 

Jl/^L^J'  J'f£.M->“'J  V'  -’’Jjc^jJ'  3iS 

jf  Jcs^o^11  : J jii  jJ'i-a  ‘<_sJ'J' 

Details: 

ArabicMainMenu_error  jJ^f  i_sJg;  J jo=>£ 4'  J1-1  4°“ 

J^CLi^I  Jl  1  io  i_S(J'  JjiJ-^jJ'  ji= 

jJI  isd^_  J ji>=>c  JJ  VJU!  .”^V jJ£<»“  :Jji3 

1  jo  (_;JI  jJI  jL  ,j£-  tidj;  Jjl.)-3^ 44 

oi-j^jjJli-j  l^i  .’’Jjo-^jJ'  tics jj=>“  :Jjii 

:Jji3  *'5; jJ'^-a  ‘lsJ'J' 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Ijo  i_sJI  Jj(J-=ojJ'  jja  tiJj;  JjL^C  J'  (jjJjilj  4° 

tiJj;  Jji>=>cJJ  -lsJ'J'  Jlsjij^'-AJ'  io^u  J'f‘£.L-Ji-J  4 
tiJ^.  JjU-^JJ  o‘-7ji_>jGJ'‘tj  ‘  :Jj(_3  e'jrjJ' 

:Jj(j  oljTjJ''— a  ^(jjfJI  'jo  i_sJ'  JjU^jJ'  u£ 

JlS^O^J'  j  ot-jjjjijJli—i  lj>i  .’’Jju^ojlJ'  l 3l? Jjst“ 

J?  JcS^o^Cj11  : J jj  »l^ jJ'i_a 

Continue  with  rec  in 

this  state. 

Details: 

ArabicMainMenu_error  jJ^f  csJj;  J jij^c  J'  ojj J4" 

jilla  j  JI^Lll^l  'jo  ijjl  Jj(_>ajJI  ji= 

:Jj(_3  o'jr  jJI  i_sJ^  Jjo-^JJ  VcsJ'J' 

<j£  Cj'fjJ^f  (jJ^  JjU-^  JJ  o^-J^jjJI^J  1  jo  (_sJI  Jj(_>ajJt  jia 

«'-r1L>OJ'l-r1  1^1  .’’Jjij-^jJ'  l3lS  jj=>“  :Jjl3  4jr  jJ'i-a  ^L3Jf“J' 

Jt/£L>“-jl<  ;  jj(i  e'j;  jJ'^-a  ‘L^J'J'  JcSJO^J'  J'f5;M_>“'l- 

”■”■=£-* 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

lsJ'J'  JgSjro^J'  0(“  j'lS^J^'J'  UJ^LSiJ^ 

^J'fjJ&r‘  csJ^  J jo^J'  UJ-U1— 1  'J  :ocsJ'cjJ'  Cjl j'lS^ J' 

fMjil  lil  l^i  . jjr (O  “  :Jjij  jj'*— a  ‘o jJ^-lIiCIj 

Continue  with  rec  in  this 

state. 
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lsJ'  (JlS J^3  J^f“  ijj^j1— 

Sl-JO'Cd'M  l|»i.”Jj(J^ajJI  Jji_S jla“  :Jj(j  d^ 

jJK-a  ‘l^JIJI  f“^U  -”^CJ?  Jl££l>“— :  Jjii  e 

Details: 

ArabicMainMenu_help  lsJ'J'  dcs^o^d'  j^£“ 

Id  ^l  jGc*-^  l. if  IJI 

‘o jG jd^  ijjdj^^j  ciJ^.  djo-^dl  uj-G1— ’  ’U1-^ 

l3lS G3  S*-* (jj-G1— 1  (“— ‘U1^  Id  V'  •”l-JV-s<-fe(“  ”  :Jjj  d^ jdlG 
d'  c3l5 _d=“  :djd  jdIG  ‘^Idu-ddd  dj£-i_j  jid (_sdl  dju^j 
‘LsdUl  dLS^L^^d'  (“^(J  dlf^^ijdd  “MO-CdG  't>l”djc>3jd' 
”.’,J^ jp  dcS^o^*1  :d jij  djr  jd''-j 


3.  ArabicMainMenu#ArabicDirections 

a.  Description 

Get  directions  to  Baghdad  Central  Correction  Facility  (BCCF).  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicMainMenu#Arabic  MainMenu 

ArabicMainMenu#ArabicMainMenu 

CleanUpAndexit_sayGoodbyeArabic#sayGoodby 

e 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

°Cxs^  l f1-*  dj£<— i  'AjlS-'c'  M 'dc^f»  20  '-tj  Lffd^  ^Ido^dd  dj£-i_i  j*d j?  £i5l? 

6  fGj  S jL>“d'  l3l5 jKJ!  tid^  l^-1  d-i^L-i  ZjtJ^  jj>  .Ml/ jsd 

j^-  >-jI  (_sd'  9  fiij  ^ j^f>d'  1  j»dj  ddcse  18  Si-il^d 

t“L>“  UJJ d°  ‘u'd' j  .9  fidj  ^  JCf“d  M jt  G  j<j£  ucsdcSf  csd^  jddij-ddd  g) 

Vi^Cd'  csdl  °G^dl  jjJjCj  <_£ i  S  jj»  ^ijjf>dl  Id  L$dl  djij-^jdl  JG  jd 
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Ja£lJ1  jJI<— S  jp  {thi£*liQ\  lil  jJ' 

Details: 

ArabicDirections_init  'Ul s?  20  A  <_sJ£ 

j^-  jt-ji  O^XS^  Lfi-j  ih^L-J  ^ j£l  <-5^  j£  'j0^1  Uf  .ML? 

ji_il  (_sJI  9  Jr  (“->  'Uc/f  18  S< — il(_>^^(_5  6  fiij  £l? Jl^J'  lJlS j^J' 

fjj  £JCc>J  o^JcSe  lsJ£  ^JoAJlI  ■‘-y^Jt 

jjjjilj  (»l  l5 '  » Jf  ijA  (Jl5  A3  OJ-^J-^  J°  ‘lWj  .9 

jJ'  ij Jl  a- j?' Jl  jjti-j  lil 

”>£j 


e.  Grammar:  ArabicMainMenu_ArabicDirections.gsl# Arabic _Rule 


NL  Slots 

V  alues 

<UserInput> 

repeatDirections,  returnMainMenu,  exitSystem 

Sample  Phrases 

Slots  Filled 

”  J  ju^  jJ'  tics  A*  £^l>“  \ s  jl” 

<UserInput  repeatDirections> 

”  J  ju^5  jJ'  tics  A* 

<UserInput  repeatDirections> 

” J. jJ'  Jl S A'*" 

<UserInput  repeatDirections> 

is i)£  J J'  jls j'” 

<UserInput  repeatDirections> 

<_S i)£  J J'” 

<UserInput  repeatDirections> 

<UserInput  repeatDirections> 

”»l5l>“l5lS jJI  ^Ls'lsJ'  i_sJ'  \g j'” 

<UserInput  returnMainMenu> 

”0l5l>“l5l S jd'  VLs'liJ” 

<UserInput  returnMainMenu> 

”CJJC” 

<UserInput  exitS  ystem> 

’VlJo*” 

<UserInput  exitS  ystem> 

’’o^lJ^JI  £-j»” 

<UserInput  exitS  ystem> 

86 


/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation.  U  serlnput  == 

“repeatDirections” 

Continue  with  rec  in  this  state. 

lastresult$ .  interpretation.  U  serlnput  == 

“returnMainMenu” 

ArabicMainMenu#ArabicMainMenu 

lastresult$ .  interpretation.  U  serlnput  == 

“exitSystem” 

CleanUpAndexit_sayGoodbyeArabi 

c#sayGoodbye 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

o jj»  ijiS 

lil  lj.i  ,”(_s o l 5 

l J'  jj^jCli 

Vls'lsJ'  “  Jji5  aLSOJ‘LSlS jJ 

,j^  1  il  1^1  i jJ' 

(jljjd  ji  Jjijj  <d^ 

Continue  with  rec  in  this 

state. 

Details: 

ArabicDirections_errorAndHelp  'i'“ 

lil  lj.1  ,”t5 's jj>  .s£-i“  :Jj(j  l5 j£) 

lsJ' 

0 “  Jji5  jell1-*  jJI 

^ili^oilijl  lit  lj.1  i”t>i_gi_yn£is jJI 

ijljjd  jl  JjlS  jjt<— «.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

0 Jf  (Jt5 Ijl 

lil  lj.i  ,”i_s "s jf>  jJlej  ls 

VLs'cjJ'  jjUjCli 

“fcStjeM  “  Jjl3  jjt 

ej  jl  lit  Ipi  jJI  j^ 

.i^JI  (jlj^l  ji  ”VltlKJI  Jj(_3  sl^ jjlej 

Continue  with  rec  in  this 

state. 
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Details: 

ArabicDirections_errorAndHelp  !il“ 

S Jp  jia  p^Aj^ 

lil  lj.1  ”ij "i jj»  :Jjl5  ls jj;' 

“pL^jJI  LSlJ  J'  'O1^ 

o<_S(_h_;lS Jjl  “pA'ijjJ  “  Jjijj 

ptillpjliilp  jp  pCj^oCjjl  til  Ipi  i”eLgLyiJiJ jjl 

cjUgd  ji  ”i>(»tJ[_Kjt  £p“  JjJj 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

repeat 

#ArabicDirections 

help 

» Jp  JjlK’jJ  (JlS  jA  gdpo*  pMj^ 

Continue  with  rec  in  this 

lil  Ipi  ,”i_s "s jp  l5 jj;i 

apLSl(J<-)l  LS<-!'  sJj£lJI  plAjiil 

“pls'ijJ'  “  Jji5  jell1-*  aLSOJ‘LSlS  jJ 
pt&lipjliilp  Up  pCj(_£i»Ajl  'p'  ‘”6l5l>“l5lS jJ' 

ji  ’’opUijaJI  £p“  Jjl3 

state. 

Details: 

ArabicDirections_errorAndHelp 

» Jp  JjlK’jJ  lit/ j^3  gdp(_>“  UJ-U1-1  pMj^ 

lil  Ipi  ,”(_s jj-i 's jj.  jgd“  :Jj(i  l5 

apLs'liJ'  i_SlJ  (jjJjCLi  pMj^ 

apLsUJ'  “  Jjijj  «lj;  “l SO^tJiS  jJ 

piAlipJliilp  (jp  pLli^odijl  lit  Ipi  i jJ 

j'  ”°p'Jl>“J'  5;?“  djjj  jjti-j.” 

4.  ArabicMainMenu#ArabicVisitInformation 
a.  Description 
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Get  visitor  information  for  Baghdad  Central  Correctional  Facility.  (This  is 
a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicMainMenu#Arabic  MainMenu 

ArabicMainMenu#ArabicMainMenu 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

UUl5(J'-jU'  (»Jt J  Of  ^IJo^UJ  jal jf  6 jC  j 

-r  ^  jJI  o^JI  »<_sl^J  o£|(_kJI  of  ^ 

(_£jl  o-j?' JI  (jjJjdj  J  1  "aJf  l“Jl|ajJ^|aJI  ,0  jo  (_$JI  £d^dj(jJJI  (jjjjdj  Jo  .  jeJaJ! 

l£|  lScJI  t“J  lj'  ''■°lSO‘lSlS jJ'  “(“LsCJ'  Jjl$  «•'£  jJI1— “  <_ S j£_  I  Sf-^t 

.i^JI  Jjljjd  ji  ’’o^lJ^JI  £f“ 

Details: 

ArabicVisitInformation_init  jal gsUi  J'  o Jo  j  !<_>«“ 

®Ut’l‘-JJI  ogdiJ^JI  Of  CIk-j^JI  j»j(_5  i_jJI  (jj^jjCjlJI  ^j(_5  ^IJ(_>saiJJ 

.  jolajl  O^-L-lljJl  0^1(_^uJI  0(0^  J  _£  J'  JI  (jjJjdj  Jo 

Ijjjiilcj  ^J  lil  Vo LgO“LSLS jJI  VlsCJI  LScJI  ®jJ^J'  <_£ 1  o dll^jJ^^JI 

”.Ja^ Ji  JlJ^i  ji  ”0(>Ul>®JI  JjJ  jjl< — a  ij jj-'i  (_s JI  y^l^L-i 

e.  Grammar: 

ArabicMainMenu_ArabicVisitInformation.gsW Arabic  _Rule 


NL  Slots 

V  alues 

<UserInput> 

repeatMessage,  returnMainMenu,  exitS ystem 

Sample  Phrases 

Slots  Filled 

SJf“  ^IfjJ^JI  ^l(»L^  JL?jl” 

<UserInput  repeatMessage> 

<UserInput  repeatMessage> 
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<UserInput  repeatMessage> 

gd^oi  A, 5jl” 

<UserInput  repeatMessage> 

”» j'ls  jJ  J 

<UserInput  repeatMessage> 

”» j'lS  jJ' 

<UserInput  exitSystem> 

jJI  ofL^LStJ  i_sJ'  jlS j'” 

<UserInput  returnMainMenu> 

”»lS(_H/LS jJI  OfCi'liJ'  AS j'” 

<UserInput  returnMainMenu> 

”»lSl>%SlS jJI  »(»cs'<JiJ  i_sJ'  0As£e!'” 

<UserInput  returnMainMenu> 

”»lSl>%SlS jJI  o^Ls'<_3<-3'” 

<UserInput  returnMainMenu> 

<UserInput  exitSystem> 

<UserInput  exitSystem> 

<UserInput  exitSystem> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation.  U  serlnput  == 

“repeatMessage” 

Continue  with  rec  in  this 

state. 

lastresult$ .  interpretation.  U  serlnput  == 

“returnMainMenu” 

ArabicMainMenu#  Arabic 

MainMenu 

lastresult$ .  interpretation.  U  serlnput  == 

“exitSystem” 

CleanUpAndexit_sayGoo 

dbyeArabic#sayGoodbye 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

o ojo  Jl  Ja 

“fistjl. L Sl3  jjJjCll  <_S 1 

lsJ^  ^  ?»i/i_n/cS jJI 

:Jjl3  jJCi  » j'lS jJs-i  11— 1 

jj- j— :  lil  l^i  _”(_j  jS-  1  o 

Continue  with  rec  in  this 

state. 
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:  JjJ  jJ'1-*  jJI  »pis!<jJI  i_sJ' 
i>Mjl  V'  •”% £<->%?£$ jJ>  p^L? 

ji  ’’epIJjjaJI  £-p“  Jjjj  el^  jJI*— a  pt^ClipJlElp 

.-^J'  ij'Jj;' 

Details: 

ArabicVisitInformation_errorAndHelp 
0  jp  ClllpjJ^pJI  eie  (_$JI  ^IpdjjpjlJI  (jj-ijdj  Ja“ 

“Pl^iuJ'  lsJ  »As^J'  ijjJjeij  pi  i_s  I 

lsJ^.  JjlP3^;  J'  (jj-ljdj  pMj-^  ^lSU^lSlS jJI 

ejlpjJ^-p  :  Jjj  » j'ls jJIm 

(jjjjdj  pdj(jtil  El  Ipi  /’<_£  I  a Jp  ^1“ 

:  JjJ  e-ljT  jJ'^-a  ‘0lSl>“l5lS jJ'  i_sJ' 

Up  pA-S^u'  ^  'f“  .’’“lSU-S^LS jJ'  »f>L5'iiJ“ 
ji  '*°p' Ju-J'  £{•“  Jjl3  jJI<— < ■  piildjpjldlp 
”.-!=£  JI  (jlj^-l 

WHEN  (  COUNT  =  2  )  "» jp  ddlp jJ^pJ'  l sJ'  gdpOu»i JI  <jjJ j1^  J»  Continue  with  rec  in  this 

nomatch  noinput  opls'JJ'  lS JI  j£ JI  ujj j ^  p'  cs jc  1  state, 

maxspeechtimeout  <_sJ£.  J ji_k»£  J'  ujj pMu^  Vsew^ jJ' 

:JjJ  jJI'-S  e jJ'm  1  l— ‘IfjJ^f 

o- jr  JI  (jjJjdj  pdj(jdl  El  Ipi  /’(_£ 1  a jp  -?-l" 

:  JjJ  jJh-*  ‘h£lw£Ls jJI  opls'iiJ'  <_sJ! 

JI  a^ljj*1  (jp  pdj^adjjl  El  Ip!  ,”a tj(j*(^i£ J 
ji  ’’aplJjjaJI  £-p“  JjJ  c-'^  jJEj  pdkjpjldlp 

J=j;JI  <j'J£j 

Details: 

ArabicVisitInformation_errorAndHelp 

ajp  dalpjJ^-pJI  eie  (_£  JI  ^IpdjjpjlJI  (jjJjdj  Jo” 

opLs'tiJi  lsJI  sJj£J'  ujAs^-1  pi  lsj£;  ' 

^Jl  (jjjjdj  pdjjdl  El  jJi  i_sJ^  Jju-= 

:Jjj  »l£ jJi^j  e jIl? jJ'm  tjj^j1— J1— j  ‘-J'pjJ^f 

oJj^JI  (jjjjdj  pdj,j(il  El  Ipi  .”(_£  I  a  Jp  J£-l“ 

:  JjJ  Jj;  jJl^j  S jJI  opls'iiJ'  lsJ' 

up  pdApejjl  El  Ipl  .’’o^o^lsLs jJI  »pL5'iiJ“ 
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ji  "s^lJ^JI  JjJ  a  W  jJ'^i  ^iikli^JliJj» 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

repeat 

#ArabicVisitInformation 

help 

Continue  with  rec  in  this 

lSiJ  ^1  L SJC 

<_sJ^  t'Cjjil  lil  jJI 

a j'c5  jjtsr1  al^  jJLi 

(jjJjdj  lil  Ipi  ’’jj jj-  1  o jj»  J^l“ 

:Jj(j  a'j; ‘*iJo*C?lS jJI  afLS'lijJ'  lS<J' 
jf>  ^Cj^oCjjl  lil  1^1  ."ngomgis jJI 
ji  ”»j»IJ(_>«JI  Jjij  aljr  f>aldj^Jliiij» 

state. 

Details: 

ArabicVisitInformation_errorAndHelp 

Jo“  i CLll^jJ^-^JI  oio  (_^tjl  ^l^djjjJJl  (jjjjdj 

a^LSttjJI  (_sJI  (*'  LSjj;  I 

<_sJ^  t'Cjjil  lil  jJI 

:Jjl3  atjl jjh-i  » jlcS jJ'm  1  t- 

a- jr  JI  (jjJjdi  lil  ji  ,”(_5  jr  1  o jj»  J^l“ 

:Jjlj  jJI  afLs'lJlJ'  csJ' 

Cj^oCjjl  lil  lj»l  .’’“(/LW/lS jJI  a^ljJ"  (jf.  f 

ji  ”«j>IJ(_>«JI  ?- A  JjJ  a  W  jjt-i 
’’.Ja^JI  ,j IJj-l 

5.  ArabicScheduling  Page  Information 

a.  Description 

This  page  simulates  the  Nuance  Caller  Authentication  (NCA)  Process. 
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b.  Page  Variables 


Page  Variables  Table 

Name 

Initial  V alue 

Description 

AcctNbr_a 

AcctNbr_b 

AcctNbr_c 

AcctNbr_d 

AcctNbr_e 

AcctNbr_f 

AcctNbr_g 

AcctNbr_h 

AcctNbr_i 

AcctNbr_J 

EnrollPin_a 

EnrollPin_b 

EnrollPin_c 

EnrollPin_d 
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c. 


Call  Flow 
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6. 


ArabicScheduling#ArabicScheduling 


a.  Description 

Ask  callers  if  they  are  enrolled  in  the  automated  scheduling  system. 
(This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicMainMenu#ArabicMainMenu 

ArabicS  cheduling#  V  oice  V  erification 

ArabicScheduling#VoiceEnrollment 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

(ji  v’JlS  ‘lsJ'JI  (Ji/^lV^-O  f>Eij  c'E^Cl^l  djd  u ?  Ut^Jj ' 

-  J  El  Eo  (_£<— fi  Jo  ..o'-io  ^jjl  1-0  1 

El  .”(££)“  djj  dj jdE-*  i/dO  dt/jo^dl  lS^ *  'd^L^ 

C’IJ“  Jjj  e-\ g  jjli— s  csJIJI  ‘d'  j»d=><j  l?*—*  1*  CjJ  jiJ  'jUjEiCj 

.(‘EijJI  t jo  (_5‘ — i  dl/JcT1*— O  lS1— ‘  UCUJ 

Details: 

ArabicScheduling_init  ‘(/JO  dcs^o^d'  pE=u  fE^c^jJ  J^l 

<_5* — i  J“  •f“^1  (jj'  Eo  (Ji-i  'jUjElCj  (jl  fA/d^ 

c-1^ jjli-i  (/JIJI  d'  {j^-i  El  ?f>E=>tjdl  Eo 

A3  1  ^d  El  djJ  t/dO  dt/£i_>j“— ^ ‘d'  <»E=>u  IdvE^  ^  CjJ 

”.(*E=(jdt  Eo  dt/^O^d'  l,jjjJi_j  (j^jj  i”IJ“  JjJ  jjli_a 

e.  Grammar: 

Arabic  Scheduling  _ArabicScheduling.gsl# Arabic  _Rule 


NL  Slots 

V  alues 

<userlnput> 

yes,  no 
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Sample  Phrases 

Slots  Filled 

”U” 

<userlnput  no> 

”(to” 

<userlnput  yes> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretations 

Arabic  Scheduling#V  oice 

serlnput  ==  "‘yes” 

Details: 

Generic_thanks”  1 

Verification 

lastresult$ .  interpretation,  u 

ArabicScheduling#VoiceE 

serlnput  ==  “no” 

Details: 

Generic_thanks”  1 

nrollment 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

nomatch  noinput 

maxspeechtimeout 

lit  Jjtj  jJLi  ulsJ^iJ33  f 

J33  (*  ' JUJ3^3— 3  lS3-* j 

'ujJ-^S-3  U£tjj  Jjj  jJ'3-* 

lS3-^  lS3-*  pt£ljgd(_>iOL>‘ 

Continue  with  rec  in  this 

state. 

Details: 

ArabicScheduling_error 

LS3-* J  .”f£u“  Jjl3  »  ^  (jcsd^ij33  f“ 

' juj33^3— 3  f^J  jJ'3-*  ? 

C5' — s  ftSEgdoOO1  j£jj  ”U“  Jjl3 

’’.fdijjjl  1-0  (_5> — 9 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Jjl3  jJ'3-*  f“c-3u)t^  ^ 

UlsJ^lJ33  f*  ' JUJ33^3— 3  (“J  “J'c  lS3-* j 
”U“  Jjii  — i  Ijjjji-j  jj-jj 

Continue  with  rec  in  this 

state. 
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.<»d=>OJ'  'O  L JlS£l>“CjJI  lS1-*  i^J^LA)L>* 

Details: 

ArabicScheduling_error 

L £•-* J  ■’VS.lj1'  Jj  J  e'jr  jJ'1-*  '0£.f“  OjJ^iJ^  f“ 
(.\fr  jjli-a  lO£f  OlsJ^O"  f“  ' jOj1-^1— ’  pJ  “J'j^ 
^l—S  IjjjJlL-l  ”1J“  Jjj 

’’.ft^OJ'  J1-*  Jjjj'^—’J' 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

o'  f ‘lsJ'J'  Jt/£jj*— ’J'  (*^=>0  Of" 

Continue  with  rec  in  this 

J(_3  10  .j>UaOd'  J1-*  'jMJf  Ot^J^L^f1  'jOj^1— 

.’V&O11  Jjj  jJ'1-*  L?J'J'  Jj£L>“— ‘J'  f^O  lS^ *  'jVJY  '^' 
c^J'JI  Jj^j^CjJI  J1-*  '  jmj"  ?  f>CjJ  £(_>*  1  jijjalej  ^ 

JjJJ^J'  lS'O  'OjJ^V  O^Oj  ‘”'J“  Jjj  e'j 

10 

state. 

Details: 

ArabicScheduling_help  Jls^u^J'  f^O  Jj;'  Of“ 

10  IJjMJY  OjJjJi*  'jOj1-^-1  O'  ‘lsJ'J' 

JlS^O"1— 'J'  f^O  lS'O  10  .ftlijjl 

i>Cj Ijjjjtieii  10  1^1  .”^0“  Jjj  Jj  jJ'1— “  jJ'J' 

OjOj  ‘”'J“  Jjj  Jj jJ'1—^  (_5 Ji Jt  Jlsjjji-jJ'  (“D=>o  J1-*  Ijs-’j0 1“ 

".fd=>oJ'  lS1—*  Jcsjo^J'  Ijjjju-j 

7.  ArabicScheduling#ConfirmAccountNbr 

a.  Description 

This  process  asks  callers  to  confirm  their  10-digit  account  number. 
(This  is  a  recognition  state.) 

b.  Special  Features 
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c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#VoiceEnrollment 

ArabicScheduling#VoiceEnrollment 

ArabicScheduling#EnrollmentPin 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

File  Expression]  [File  Expression]  [File  Expression]  [File[  J» 

Expression]  [File  Expression]  [File  Expression]  [File  Expression]  [File 

Expression]  [File  Expression]  [File  Expression] 

[500msecs]  J  W  Jjii  1  ‘'ct/co3  lA?  ? 

,”U“  Jjij  jJ'1-* 

Details: 

GenericPromptConfirm_partl”^^L>“ 

File  Expression:  ’’numbers/”  +  AcctNbr_a  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_b  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_c  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_d  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_e  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_f  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_g  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_h  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_i  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_j  +  “_high.wav” 

GenericPromptConfirm_part2 

Silence:  500  msecs 

GenericPromptConfirm_yesNo  .’V^u“  Jjii  jJCi  ‘"'ci/co-3  ^ 

jjlcj  1  lit 

e.  Grammar: 

Arabic  Scheduling  _ConfirmAccountNbr.gsl# Arabic  _Rule 
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NL  Slots 

V  alues 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”U” 

<userlnput  no> 

"tt& 

<userlnput  yes> 

/.  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretation,  u 

l,ji 

Arabic  Scheduling#  V oiceE 

serlnput  ==  “no” 

Details: 

Gcncric_imSorry”!'-Aj-'  'o'“ 

nrollment 

lastresultS  ■  interpretations 

ArabicScheduling#Enroll 

serlnput  ==  “yes” 

Details: 

Generic_great’ 

mentPin 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

URL[  <j^  Li 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  ‘  '-1' 

state. 

maxspeechtimeout 

‘  L»  j»J  LI  djdj 

,”U“  Jjij  jJt'-j 

Details: 

ConfirmAccountNbr_errorLI“  ?tjj  6^ 

URL  Expression: 

genPhoneN  umber(  ac  countNbr) 

GenericPromptConfirm_yesNo  Ll“ 

i»J  LI  JjJj  jJLj  1 
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WHEN ( COUNT  =  2 ) 

URLf  I<jlPJ  f“c3J  uLJ  Li 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  jO'1-*  LI 

state. 

maxspeechtimeout 

1  l^cs^o-3  L»  lA?  (“0  LI  Ojj 

.”U“  Jjij 

Details: 

ConfirmAccountNbr_error  Ll“ 

URL  Expression: 

genPhoneN  umber(  ac  countNbr) 

GenericPromptConfirm_yesNo  u'1^  Ll“ 
i>J  LI  .’V&u**  JjJj  jJI^-a  ‘  Lo 

”.”IJ“  Jjij  jJl-i  ‘  L»  lAs 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

lSuu'  Uf“  JLlklii  J  As  J1 
URL[  Iuls^J  fA-'Ac  asj  Li 

Expression]  A'1-*  ‘  L»  clA  LI 

‘  tiAs  (»lJ  LI  Jjds 

,”U“  djij  jd^ 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmAccountNbr_help  J  A? jl“ 
i  jllil  Iji  tfVJ"  c5(ju'  Of  JLlicll 

”I<JlSAJ  fiA-r^C  f“c3J 

URL  Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm_yesNo  lA  Ll“ 
fj  LI  .”{•££)“  djd  jJl*— “  1  S^O-23  Lo 

”.”IJ“  Jj(_3  »ljr; jJI'-j  ‘  Lo 
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8.  ArabicScheduling#ConfirmAccountNbr2 

a.  Description 

This  process  asks  callers  to  confirm  their  10-digit  account  number.  (This 
is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicS  cheduling#  V  oice  V  erification 

ArabicScheduling#VoiceVerification 

Arabic  Scheduling#NbrCount  V  erify 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

File  Expression]  [File  Expression]  [File  Expression]  [File[ 

Expression]  [File  Expression]  [File  Expression]  [File  Expression]  [File 

Expression]  [File  Expression]  [File  Expression]  Jal  til  Ja 

lio  Ijl  •”{%.&“  Jjl3  ‘  .”'0“  dj(J  jJt1— •  ‘ 

Details: 

GenericPromptConfirm_partl”^t>ijjl  <J»“ 

File  Expression:  ’’numbers/”  +  AcctNbr_a  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_b  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_c  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_d  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_e  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_f  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_g  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_h  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbr_i  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  AcctNbrj  +  “_high.wav” 

GenericPromptConfirm_part2  >-»  J» 

GenericPromptConfirm_yesNo  Jjj  jd'1-*  ‘  ^  'd“ 
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Jjj  »ljr  jJLi  'J>  lA$  f“J  'J 


e.  Grammar: 

ArabicScheduling_ConfirmAccountNbr2.gsl#Arabic_Rule 


NL  Slots 

Values 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”U” 

<userlnput  no> 

It  r  .  ?? 

<userlnput  yes> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

MlJ  'u' 

ArabicScheduling#Voice 

serlnput  ==  “no” 

Details: 

Verification 

Generic_imSorry”!i-«(jJ  'o'“ 

lastresult$ .  interpretation. u 

•VC 

ArabicScheduling#NbrCo 

serlnput  ==  “yes” 

Details: 

unt  Verify 

Generic_great’  ’  “ 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

URL[  'OcsoJ  f“i3j  u'1-^  'J 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  lj»  jltil  lil 

state. 

maxspeechtimeout 

1  O^ls  fJ  Jjj 

,”'J“  Jjij  jJ'1-^ 

Details: 
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ConfirmAccountNbr_error  pjj 

URL  Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm_yesNo  u^ 
pj  lit  ,”p^j“  jO'1— *  ‘ 

Jjj  stj; ‘  'clS^u-3  uA/ 

WHEN ( COUNT  =  2 ) 

URLf  1  jcpj  p^m'u^  pc3J  u^  A 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  jJ'1-*  ‘  u1^ 

state. 

maxspeechtimeout 

‘  I^lS^U-3  <jA_S  pJ  ,”p^  j“ 

,”U“  J jj  «•'£ 

Details: 

ConfirmAccountNbr_error  pjj  u'^ 

URL  Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm_yesNo  u^ 
pj  lit  ,”p^j“  3jl3  frljr  jJ'1— s  ‘ 

Jjj  jjli-a  i  '^LS^U-3  lio  jfii^s 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

pijjj  U^  A  t/Utll  Up  -^Aclil  jl  jl 

Continue  with  rec  in  this 

‘*'c</CO“  ]URL  Expression[  'ulSjJ  pUMu-“C 

Jjc3  jJCj  ‘  'ci/CO3  ^3  lAlS  pJ  Ijl  ,”p^j<l  Jjijj  jJI'—i 

state. 

,”U“ 

Details: 

ConfirmAccountNbr_help  i_5uu'  up  jGIUjI  jl  \g  J“ 

£.Pl>“”'ulsG  pGi—iljjj^-  pjjj  U^  ‘^JUiaJ‘-r1  p^1— i 

URL  Expression:  genPhoneNumber(accountNbr) 

GenericPromptConfirm_yesNo  ‘'Vuju-=  u1-^ 

Jjj  jjli-s  i  '-10  uA/  pJ  lit  ,”p£j“  3jii  eljr  jJ'1-* 
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9. 


ArabicScheduling#ConfirmEnrollPin 

a.  Description 

This  process  asks  callers  to  confirm  their  4-digit  enrollment  PIN.  (This  is 
a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#EnrollmentPin 

ArabicScheduling#EnrollmentPin 

ArabicScheduling#EnrollCheck 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

File  Expression]  [File  Expression]  [File  Expression]  [File[  — Jo 

Expression]  500[  cknsecs]  JjJ  ‘ 

.”U“  JjJj  elj  jcJ'1 — a  ‘  SCO3  ij-As  (“J  'd 

Details: 

Gener  icPrcmp  tConf irm_part  1  fo*  J»“ 

File  Expression:  ’’numbers/”  +  EnrollPin_a  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  EnrollPin_b  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  EnrollPin_c  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  EnrollPin_d  +  “_high.wav” 

GenericPromptConfirm_part2’T^L5^(_K>  J»“ 

Silence:  500  msecs 

Generic PromptConfirm_yesNo  .’V^u“  Jjj  jJ'1-*1 

Jjj  »! £ jJI<-i  1  f“d  ^ 
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e.  Grammar: 

Arabic  Scheduling  _ConfirmEnrollPin.gsl# Arabic  _Rule 


NL  Slots 

V  alues 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

<userlnput  no> 

”fto” 

<userlnput  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation. u 

l(ji 

ArabicScheduling#Enroll 

serlnput  ==  “no” 

Details: 

Generic_imSorry”!l-j(jj'  'ij'“ 

mentPin 

lastresult$ .  interpretation,  u 

ArabicScheduling#Enroll 

serlnput  ==  “yes” 

Details: 

Generic_great’ 

Check 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

URL[  LI 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  <djr  jjkj  lie  LI 

state. 

maxspeechtimeout 

1  L»  ilA?  LI  JjlS 

,”U“  Jjij  jJkj 

Details: 

ConfirmEnrollmentPin_error 

URL  Expression: 
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genEnrollNumber(enrollmentPin) 

Generic PromptConfirm_yesNo 

.”f^o“  Jjii  jJi1-*  ‘ 

Jj(i  jJCj  ‘  oAs 

WHEN ( COUNT  =  2 ) 

URL[  fA_sJJ  fiij  u'1^ 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  jO'1-*  ‘”'cc?C‘->=3  0'^ 

state. 

maxspeechtimeout 

1  '^cs^o-33  oA_s  f  J  lit  ,”f£011  Ojj 

,”U“  Jjij  jJbo 

Details: 

ConfirmEnrollmentPin_error  O'-^ ' 

’V  A_s-G  fiij 

URL  Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm_yesNo  o'1^ 

f  J  lit  ,”f£0“  Jjl5  “  ‘ 

”.”IJ“  Jj(_3  elj- jjt-i  ‘  '-13  0)A/ 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

fJJ  ^LfO3  l#00'  o'  Of  JAcji  lSlJC^ 

Continue  with  rec  in  this 

fijjj  O'^  L'  ‘C-ScA'JM  fA^JJ  <-)cS£iJJ*-;;-1J' 

'0  ]URL  Expression[  fA5JJ 

f  J  '0  .”^0“  Jjij  «'£ jJI'-O  ‘  '^lS^lK3  'A  O'A 

,”U“  Jjij  e'j  jJI'-s  'A  OA^ 

state. 

Details: 

ConfirmEnrollmentPin_help  t/0LJ“ 

lsOO'  O'  Of  -^A^' 

fjj  0'*A  'A  ‘cjoAsM  f  A/aJ 

”fA^JJ 

URL  Expression: 

genEnrollNumber(enrollmentPin) 

Generic PromptConfirm_yesNo  O'A  'A“ 
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L 5^0=  '^3  1^1  •”&&“  Ojd  ‘  ^ 

”.”IJ“  Jjj  *1^ jJLi  i  I^LS^O-3  l^3  i>As 


10.  ArabicScheduling#Enroll  Check 

a.  Description 

This  process  asks  callers  if  they  would  like  to  “enroll  me  now.”  For 
demostration  purposes,  linsk  to  additional  verification  information  is  not  included  in  this 
application.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#ConfirmEnrollPin 

ArabicScheduling#NbrCountOne 

d. 

Pre-rec  Prompts 

Type  and  Condition 

Action 

Entry  Type  =  initial 

l<j  <jAVc?0“  lio  CjJI  fdauM  fd  'uu'  ‘dO 

jCjiill  j  0  Jl?  jtaJI  _»jo  Lyj  jL  •-*  (jp 

4c3lS  jtaJI  j'  l£ jod  fijju'  J^-2'  Aks J? 

bib  ,d=n_3> — a  ,0 tai-jj  .j.iiljjj.  IJ^JJ  Idjjj  jLJI 

:0jl3  jJI 1 1  jj1-3 

Details: 

EnrollCheck_init  jo-=>J'  ls<J£;  cm  Ijjl  1  ja-i^ 

c3lS (J£.  Cjj(_paJI  3  1  j  U-^V^O”  “JlS ,3^3  .Cjj(_KaJI 

oJjlS jl  <_£ »(Jl 5 J^3  LJf“  ,3LSlJ  £- j(jJ 

•  f^Uf3  'Cjjj  ji>JI  bib  .lajjcj  _6 UJ^lS 

’’.’’i/lxJjo1"  :JjJ  jJ  ‘ ' jj1-*  3LsJf‘5;'-rJ  1^0 
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e.  Grammar:  ArabicScheduling_EnrollCheck.gsl#Arabic_Rule 


NL  Slots 

Values 

<userlnput> 

enrollMeNow 

Sample  Phrases 

Slots  Filled 

<userlnput  enrollMeNow> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

serlnput  == 

“enrollMeNow” 

Details: 

Generic_thanks”  1 

ArabicScheduling#NbrCo 

untOne 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

: Jjj  jJI  i Emu 

Continue  with  rec  in  this 

nomatch  noinput 

’’(/UtijO1" 

state. 

maxspeechtimeout 

Details: 

EnrollCheck_errorAndHelp  I^mu 

:Jjii 

_  .  t _  a 

WHEN ( COUNT  =  2 ) 

:JjJ  jJ!  %?‘-V&.m  Emu 

Continue  with  rec  in  this 

nomatch  noinput 

’’uuJ^u^" 

state. 

maxspeechtimeout 

Details: 

EnrollCheck_errorAndHelp  '-mu 

:Jjl3  ^z 
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ii 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

Continue  with  rec  in  this 

state. 

Details: 

EnrollCheck_errorAndHelp 

:Jjii  jd'  \ 

»???  „  .  t _  44 

1 1 .  Ar  abicScheduling#EnrollmentPin 

a.  Description 

This  process  asks  caller  for  his  or  her  4-digit  enrollment  PIN.  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#ConfirmAccountNbr 

ArabicScheduling#ConfirmEnrollPin 

ArabicScheduling#ConfirmEnrollPin 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

<j4%5  J  j? jJ  j'J'  j£u  Li'd  cCti) 

Jjij  jjl  jJ'  aljij  .faij  jl  fii  ijcjJI 

jJ  S^l—I jlJI  ji 

Details: 
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EnrollmentPin_init'  ‘-j j  j'J  "o C j? jJ  c'ljjl  JJ 

elj jJI  liljij  lojl^ jl  jJI  lo  -sl^^l  j^cs  ls1— ‘JO 

”.f“^Jl_S£  jj1  jJ  j'JI  j'  Jjljj  jJI  ^  0?J 

Entry  Type  =  reentry 

.LSJ£  1  » Jf“  r^JcSJo^  jf  jJ  °£V j'J'  j'  J jO  jJ' 

Details: 

EnrollmentPin_reentry  j? jJ  flOj'  j'JI  j'  Jjj  jJ1“ 

”.l5Jc’'  sJ? 

e.  Grammar:  ArabicScheduling_EnrollmentPin.gsl#GetPinNumber 


NL  Slots 

V  alues 

<enrollPin> 

”[four-digit-string]”,  jl 

<digit_one> 

Ij  ? 

<digit_two> 

j  ? 

<digit_three> 

90^-L_Jjl  ^odlljdl  j  ? 

<digit_four> 

90£-L_J^)i  ?odjl(Jdl  ?  ^Cll  90(_£(jl^»dl  9Odj(_JJJ 

Sample  Phrases 

Slots  Filled 

^  \  L_1  jl 

<digit_one  -j' j> 

<digit_two  jl  j^l> 

<digit_three  »cjljdi> 

<digit_four  J> 

<enrollPin  -£' j-  jl  jilil-oiIjlJeii->o^i-j jl 

”dtmf- 1  dtmf-2  dtmf-3  dtmf-4” 

<digit_one  -  j' j> 

<digit_two  '>  jl  j1^ 

<digit_three  »cjljdi> 

<digit_four  »£>>. j'> 

<enrollPin  -£' j-  jl  j4jUililJili->o£-i_i jl 
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/.  Actions 


Condition 

Action 

joto 

Details: 

Generic_thanks” ' 

Assign:  EnrollPin_a  = 

lastresult$. interpretation. digit_one 

Assign:  EnrollPin_b  = 

lastresult$. interpretation. digit_two 

Assign:  EnrollPin_c  = 

lastresult$. interpretation. digit_three 

Assign:  EnrollPin_d  = 

lastresult$. interpretation. digit_four 

Assign:  enrollmentPin  = 

lastresult$. interpretation. digit_enrollPin 

ArabicScheduling#Confir 

mEnrollPin 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

jJ  jU  -^ch3  j'  Jjl3  jJ' 

Details: 

EnrollmentPin_errorAndHelp  jJ'“ 

jf“ jJ  %l-r1  j'J'  -^cP3  J*  J Jtj 

Continue  with  rec  in  this 

state. 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

jJI  j f  jJ  fljjjl  j'J'  jl  Jj 

Continue  with  rec  in  this 

state. 
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Details: 

EnrollmentPin_errorAndHelp  Aj;  jJ'“ 
jf> jJ  f'Jji  j'JI  jl  J Jc3 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

jf. jJ  jlJI  -i=£i>=>  jl  Jj(i  Ajr  jJI 

Continue  with  rec  in  this 

state. 

Details: 

EnrollmentPin_errorAndHelp  jJI“ 

jf> j2  j'J'  -t^cA3  jl  J jj 

12.  ArabicScheduling#NbrCountOne 

a.  Description 

This  process  asks  callers  to  count  from  1  to  9.  (This  is  a  recognition 

state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#EnrollCheck 

ArabicScheduling#NbrCountTwo 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

‘S^C  jj»  dalJCj  19  ^ Jl  l  jj- Jl  j'  ‘fAJ  <jf 

ijj;  f'AJloO  IfJ^'-r1  .  l— * JJ^CjJI  (jj.  ^JiJI  ^UajJI 

{jf  -A  IlllJJ  AJjj  AdjJ-^JIA  lo^-J  Jladj^j  J^dljl  J(_>ujl  elll^jJj-^JI 
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0 Jp  eljfjJI  ‘u'JI  .p'-^l1LS<J'3Cl>‘  ‘9  lsJ  1  Up 

■  °^(_>Ji‘-J  pijjj  csJ 

Details: 

NbrCountOne_init  diiljdj  ‘9  uJ  1  up  p<4jp  1  j£  j'  jo3  v'a^c  4“£  <-%'  ejf*" 

(_5 i_i j^ejJI  (jj»  uJIJI  pd=G<-^  u^V1— ‘ls  lS1— °ls  J1— “— 'p  A1' jp 
(j£  pcSlJi^j  esijjsj  Jldl^-pjliil  p<il(jp  1  ^UjJI  »i_S J(_kJ'  i_A 

‘9  lsJI  1  up  » jp  Ajo3^-1  -^iJ  ‘u'JI  .ptSlA/u^u3  eJ?  -2^1  A  JJ 

pjj  (_sJI  loCjlJdl  Itjljjdlll^lj 


<?.  Grammar:  ArabicScheduling _NbrCountOne.gsl# Arabic _Rule 


NL  Slots 

Values 

<uselnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

<uselnput  nbrCount> 

f  Actions 


Condition 

Action 

Goto 

lastresult$. interpretations 

selnput  ==  "nbrCount” 

ArabicScheduling#NbrCo 

untTwo 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

1  up  S-2^' j  '» Of  ‘,J'£  A j (_K>M  eljfjJI 

Continue  with  rec  in  this 

nomatch  noinput 

fL$J  ‘osliljcli  j  t9  l sJ 

state. 

maxspeechtimeout 

Details: 

NbrCount_errorjr'jJI“  A ju-=>m  -^J'  *' 
AA  i9  lsi3  1  up  A^-lj  s jp 
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ladjljdi  ijljdiliJj-l  j 

WHEN ( COUNT  =  2 ) 

1  Q If  “ Of  ‘ 

Continue  with  rec  in  this 

nomatch  noinput 

(“lSJ  4adlljcl]  j  49 

state. 

maxspeechtimeout 

Details: 

NbrCount_error  p jo^m  -^J' 

:liaio  i9  esc!'  1  jf“  ° Jf  1  ,<-!'£ 

ladjljdi  j 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

e'jUjJ  ‘f-4J  lS^-1  j(j-a  df£.  <-%'  Of 

Continue  with  rec  in  this 

49  lsJ  1  up  ° Jp  4 

CfiClsIJCll  J  •  blilo 

state. 

Details: 

NbrCount_help  vUc  <-)ft  Of“ 

lo^lj  djtiio  i9  1  d»  o^lj  oj^ 

(_sJI  ioCjIJCj 

13.  ArabicScheduling#NbrCountThree 

a.  Description 

Number  count  three  for  voice  model  collection.  (This  is  a  recognition 

state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicS  cheduling#NbrCountT  wo 

ArabicScheduling#RecordSecretDate 
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d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

up  ls  jc  j? 

Details: 

NbrCountThreeJnit’T^J^Ui  u jj;'  Yjp" 

e.  Grammar:  Arabic  Scheduling JNbrCountThree.gsl# Arabic  _Rule 


NL  Slots 

V  alues 

<userlnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

^  1  (jd J 1  - fidj ! (Jd-1- 0(_£ ’ ’ 0^ 

<userlnput  nbrCount> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

•Ve 

ArabicScheduling#Record 

serlnput  ==  “nbrCount” 

SecretDate 

Details: 

Generic_great’ 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

1  up  “ up  y^ju-^s-1  jJl 

Continue  with  rec  in  this 

nomatch  noinput 

?L3J  ioClilJCLi  j 

state. 

maxspeechtimeout 

.a£U*^J 

Details: 

NbrCount_error  A1 ju^m 

i9  uJ  1  Up  ° up 

pjj  (jJI  ioUjIJUj  ijl 
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WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

1  <jf  s jf  jJI 

ciJI  ‘oCjlJcj  ijjljCjli j  i9  csJI 

Continue  with  rec  in  this 

state. 

Details: 

NbrCount_error  ”jJ'“ 

i9  LSI-!'  1  Uj> 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

<-%  Up 

Continue  with  rec  in  this 

j  '» jf  ‘,J'^  ,cj JgxJI  ‘9  lsJ'  1  uf> 

state. 

tfiClllJCj  j  ;  1  jiilo 

Details: 

NbrCount_help  ^'o^c  <-V&  op** 

.CjJU-av1  jJ'  ‘j“AJ 

‘u'u*— ;  1  jdio  t9  1  (jf»  j  ej^ 

(_sJI  ioCjIJCj 

14.  ArabicScheduling#NbrCountTwo 

a.  Description 

Number  count  two  for  voiceprint  collection.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicS  cheduling#NbrCountOne 

ArabicScheduling#NbrCountThree 
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d. 


Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

<jj»  ,j£l(Jj 

Details: 

NbrCountTwo_init”V^Jl>=!'-s  Of  l s jc1  -jc'Jj" 

e.  Grammar:  ArabicScheduling_NbrCountTwo.gsWArabic_Rule 


NL  Slots 

V  alues 

<userlnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

^  1 J  9 - \ - ©dl ! (JCll- - ©dl ©£-  L_1  ©^jl^dl- ’ ’ ©£ (_^udl 

<userlnput  nbrCount> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

serlnput  ==  “nbrCount” 

ArabicScheduling#NbrCo 

untThree 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

1  Of  j  ”» Jf  ‘,J'£  j 

Continue  with  rec  in  this 

nomatch  noinput 

f(JJ  L sJ'  diiilo  i9  lsJ' 

state. 

maxspeechtimeout 

Details: 

NbrCount_error  p Ojr'jJI" 

diiilo  i9  lsJ  1  Of  “ Jf  ‘,J'£ 

oOjIJOj  ‘  (_jJI  1 

WHEN ( COUNT  =  2 ) 

1  Of  SJjdj  » Jf 

Continue  with  rec  in  this 
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nomatch  noinput 

c\ij  lsJ'  ‘oCjIJCj  Uiaio  19  i_sJ' 

state. 

maxspeechtimeout 

Details: 

NbrCount_error  Cj 

ajaio  19  l sJ  1  uf> 

(_sJI  ioCjIJCj  j 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

eljr'jJI  Jc>a  J^l  (jj. 

(jf“  S Jf  -^J'  ‘9  tiJ'  1 

lScJ'  toCjlJCj 

Continue  with  rec  in  this 

state. 

Details: 

NbrCount_help  ‘-fe1 

.Cjju^aL-J  ‘(“AJ  LSCjj,j^a 

‘u'U— ;lialo  t9  lsJ'  1  Of  j  oj^a 

jajjj  (_5J|  lailllJCj 

15.  ArabicScheduling#Nbr  County  erify 

a.  Description 

Number  count  for  voice  verification.  This  process  asks  callers  to  count 
from  1  to  9.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#ConfirmAccountNbr2 

ArabicDetaineeAppt#ArabicDetaineeAppt 

d.  Pre-rec  Prompts 
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Type  and  Condition 

Action 

Entry  Type  =  initial 

i9  LS cJl  1  (J(*  Cljjj-saL-l  ^ 

(_£(_)!  4fiClllJdj  4  jl 

Details: 

NbrCountVerify_init  * Of  ^AJJ“ 

caClilJdj  4^1^^1114 49  1 

e.  Grammar:  Arabic  Scheduling _NbrCountVerifiy.gsl# Arabic  _Rule 


NL  Slots 

Values 

<uselnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

1  j’ ’  -  ^  1  (jLij  1- olIj  1  Jcij- 0^ 

<uselnput  nbrCount> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

selnput  ==  “nbrCount” 

(jj»  -  tSlldiJI 

Details: 

NbrCount Verify_post  0?  Tiilliiijl  ?cj 

ArabicDetaineeAppt#Ara 

bicDetaineeAppt 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

1  Of  j  '» Jf  ‘,J'£  >ti eljfjJI 

Continue  with  rec  in  this 

nomatch  noinput 

j»i3j  lsJI  iJjdjUjj-lj  diiiit.  19  lsJ' 

state. 

maxspeechtimeout 

Details: 
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NbrCount_error  p 

1 J  l9  <_£(_]!  1 

L 5<JI  ‘oCjlJCj 

WHEN ( COUNT  =  2 ) 

1  up  ° J?  ‘ 

Continue  with  rec  in  this 

nomatch  noinput 

(*l3J  coCIi'JCj  j  *9 

state. 

maxspeechtimeout 

Details: 

NbrCount_error  j-> -^J' 
hjuilo  i9  uJ  1  Up  ° Jp  ‘ 

1  pijjj  l sJl  j 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

e'jfjd  ‘p^'-Aiu^u^  up  jj-JI 

Continue  with  rec  in  this 

c9  1  Oj^a 

<_£(_)!  toClllJdl 

state. 

Details: 

NbrCountVerify_help  up  uilicjJJ" 

‘,d^  e'jr’jJI 

‘u'lP— t9  ud  1  Up  j  oj^ 

isCjIJCj 

16.  ArabicScheduling#RecordReminder 

a.  Description 

This  process  simulates  the  NCA  process  of  recording  a  callers’  hint  to 
their  secret  date.  For  demostration  purposes,  this  recording  is  not  saved  to  any  backend 
database.  (This  is  a  record  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 
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Entry  States 

Exit  States 

ArabicScheduling#RecordSecretDate 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

ij^OJ  °lS Jjij  .lS  ji_«J  jf <-!' 

Details: 

RemindDate_init  <jl  J»  Gel^ j 

Jjlj  el{T  jJ'  .LS  (_5i_a  ijCjJI 

uc<jj  °lS 

e.  Actions 


Condition 

Action 

Goto 

- 

AjjJ  ‘  'ul>“C  l S1-* 

CleanUpAndexit_sayGoo 

dbyeArabic#sayGoodbye 

Details: 

RemindDate_post  ^  AiJ  ‘ 

fdijji-j  (_5< — a 

f.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

6^Jl*]JI  IjJjjdi  ,jl  J»  i  j 

Continue  with  rec  in  this 

nomatch  noinput 

state. 

maxspeechtimeout 

Details: 

RemindDate_error  J  2“  ‘  '*'cl  j“ 
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l5 J  “ls joaJ'  ofiTAJl 

-r  j?JI  (_5< — a 

WHEN ( COUNT  =  2 ) 

ijJjjcii  (jl  Jo  i  l«l^j 

Continue  with  rec  in  this 

nomatch  noinput 

state. 

maxspeechtimeout 

Details: 

RemindDate_error  J  ^ c>4%?  2“  ‘  '*'cl  j“ 

LSCjJI  £>(_£  (_5 J  1  jJjtjjUj 

ls  joaH 

17.  ArabicScheduling#RecordSecretDate 

a.  Description 

This  state  is  an  Arabic  subsitution  process  for  the  English  GetSecretDate 
and  ConfirmSecretDate  processes.  (This  is  a  record  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#NbrCountThree 

ArabicScheduling#RecordReminder 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

lOjL^ Jl  oio  (_5< — fi 

tiJj;  1  Jo^^  jIcj_i  AJ^^as  j6j  ‘Jlcii^^jl  Jij^JI 

jal.i  J^lalJli—i  oJjj  »l^ jJI  i(j jol^  ucs j£)JI 

.  1998  Jl? jsJ  u?  J  j'J'  : ' J^-1^  toj^JI 

Details: 
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RecordSecretDate_init  lsJ'  JjmX)  j<_>“  10  J' 

J  »(_>%£  S J° J  ‘-dcj^JI  Jlj(_Kjl  f‘AJlo'0  '— Gl>“J  % S JlkJI 
t ^ jJI  ‘ul f  jdj  'juj^1— 1  VJ<-fc  • 01— ^ *-* Jc?  (j lS lsJj;  1 

f  J  jU' :  litSio  t:Co-G'  jA--  oJjii’M998  Jls jsd  u 


e.  Actions 


Condition 

Action 

Goto 

is 1 Asd  d jaljji 

Details: 

RecordSecretDate_post  ^  A&J  d 

”l5 ^ jf>J' 

ArabicScheduling#Recor 

dReminder 

f  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

ls jo“ Jl  jj> Jl  J jij  jJI 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

Details: 

RecordSecretDate_error  Jjij  djr  jJ'“ 

”lS  ^  Jfj' 

state. 

WHEN ( COUNT  =  2 ) 

lS  ji_«J  j<»J'  Jjtj  *1^  jJ* 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

Details: 

RecordSecretDate_error  Jjij  djr jJ'“ 

”lS jfnJI 

state. 

18.  Ar  abicScheduling#V  oiceEnrollment 

a.  Description 

Simulates  the  NCA  voice  enrollment  process.  This  process  asks  callers 
for  their  10-digit  account  number.  (This  is  a  recognition  state.) 

b.  Special  Features 
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c. 


Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#ArabicScheduling 

ArabicScheduling#ConfirmAccountNbr 

ArabicScheduling#ConfirmAccountNbr 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

t/1-*  ^s-A'  Ajrl  0 

» Jl_£^A'  fbkj jj£C_]  OAf  (0  lil  i Jjl3  j'  A'^a 

j A Jf  V jj'  Sg£;l Jf  jA'  ji  <n_>al£ Jl  ^Ijjl 

■  ‘Al^cA  A/jo^A'  Aj;'  Of  “* jlhAJ 

Details: 

VoiceEnrollment_init  (*slj c-mJ1  JjA  u“ 

j»J  lil  l JU%J'  Aj(jj  jl  Ajt'jA'  ^jo^AI  lsJ^. 

Aj|  jJI  tltnjbjc-j  jl  oj* al^JI  S Jjjig-JI 

A/JO^A'  JjA  Of  Aa j<JAJ  jblj^  i_j  jjl  Sj-jd Jj>”.  .-icSJjr  ljI 

Entry  Type  =  reentry 

fi JjjSg-Jl  (Jl^l  f.\^  jjl 

Details: 

VoiceEnrollment_reentry  »o-AcA  4AA  i jA^J'  J'£A  Ajr'jJI" 

e.  Grammar: 

ArabicScheduling_VoiceEnrollment.gsl#GetAccountNumber 


NL  Slots 

V  alues 

<AccountNumber> 

”[ten-digit-string]”,  ocso'e1— J- 0<r? cb'e1— 1_ 0 'f1— -1- _ _ _ ’ J-AilAA-Jjd j- 

jIlhI 

<digit_one> 

o^-^Cli  ?odil(Jdj  ^ j  ^ 

<digit_two> 
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<digit_three> 

j  ^ 

<digit_four> 

0£-(_ Jjld)  ?odll(Jdj  j  ^ 

<digit_five> 

,0(_£(j\^CLi  ?odll(Jdj  j  9 

<digit_six> 

O^-^Cll  ,6(_£(j\^CL}  ^odlljdj  j  9 

<digit_seven> 

e^(_^udj  ,0(^(j\^CL}  _ )1  5odll(Jdj  j  9 

<digit_eight> 

O^-^Cll  90^-L_Jjl  ^odlljcll  j  5 

<digit_nine> 

1  9  (jxdj  ? 

<digit_ten> 

e^-^udl  5odll(Jdj  j  ? 

Sample  Phrases 

Slots  Filled 

1  ^ ^-’’ill'll)1-1' 

<digit_one 

<digit_two  “lSu'(>l-j> 

<digit_three  “i/jV1— '> 

<digit_four  »L>“f‘C> 

<digit_five  *o^£> 

<digit_six  f<_n “C> 

<digit_seven  -j;1  j> 

<digit_eight  o'u^'> 

<digit_nine  -H j> 

<digit_ten  u'lm'> 

<AccountNumber 

'  j-u'ilf— 1 

”dtmf-8  dtmf-8  dtmf-8  dtmf-5  dtmf-5 

dtmf-5  dtmf-1  dtmf-2  dtmf-1  dtmf-2” 

<digit_one 

<digit_two  “lSuVl-j> 

<digit_three 

<digit_four  ‘>o“i‘C> 

<digit_five  »L>“f‘C> 

<digit_six 

<digit_seven  -H j> 

<digit_eight  o'u^'> 

<digit_nine  j> 

<digit_ten  <j|<j‘-,l> 

<AccountNumber  “[ten-digit-string]”> 
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/.  Actions 


Condition 

Action 

Goto 

- 

Details: 

Generic_thanks” ' 

Assign:  AcctNbr_a  =  lastresult$. interpretation. digit_one 

Assign:  AcctNbr_b  =  lastresult$. interpretation. digit_two 

Assign:  AcctNbr_c  =  lastresult$. interpretation. digit_three 

Assign:  AcctNbr_d  =  lastresult$. interpretation. digit_four 

Assign:  AcctNbr_e  =  lastresult$. interpretation. digit_five 

Assign:  AcctNbr_f  =  lastresult$.interpretation.digit_six 

Assign:  AcctNbr_g  =  lastresult$. interpretation. digit_seven 

Assign:  AcctNbr_h  =  lastresult$. interpretation. digit_eight 

Assign:  AcctNbr_i  =  lastresult$.interpretation.digit_nine 

Assign:  AcctNbr_j  =  lastresult$.interpretation.digit_ten 

Assign:  accountNbr  =  lastresult$.interpretation.accountnumber 

ArabicScheduling#Confir 

mAccountNbr 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Continue  with  rec  in  this 
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nomatch  noinput 

J JJ  j'  j2'  1 <_£ 2^  j£^2' 

state. 

maxspeechtimeout 

pljjl jl££2I  “u -2^21 

Details: 

VoiceEnrollment_error  2jr'  up“ 

I_i  (_5‘ — i 

» ju%2'  J Jii  jl  J'^j'  j2'  lsJ& 

o,J-a'c  j'  fl(jj' 

WHEN ( COUNT  =  2 ) 

^UijL-i  S(/2f£  LS1-^  2jU  t> 

Continue  with  rec  in  this 

nomatch  noinput 

J jlJ  j'  2^  jJ'  ^ l$2^  l-i  j£^2' 

state. 

maxspeechtimeout 

o^lj-JI  j»l jjl  S j(j%2' 

Details: 

VoiceEnrollment_error  «-mJI  2jr'  0?“ 

I_a  ^UajL-i  (_5i_a 

J jl3  j'  jJ'  1  (_s2g;  S 

»,j-alj-  Jl  pi  jjt 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

2jU  Uf 

Continue  with  rec  in  this 

f>l jjl  i jcP^Jl  j^cj jj£S-i  (jl  csJ'J'  As^l Jf2l 

s'jr'jJI  f'lij'  ° j<j%2'  Jjls  j'  J' 

f>lc3jl » ju^^J'  jjc^  cAg  (“J  l^l.f‘^i-r1'ijjicLrl  *i>“'j;2! 

»lj|  jjli_i  lojdijjLj  ^lil(jl  ajljj  S  jl  fiA-jljjji^C-J  Ojj^al^JI 

2c  Of  2a JlAJJ  j^Jf  L_1  J(ji  Sj-J-I Jj» 

state. 

Details: 

VoiceEnrollment_help  si/2f£  c?1-*  eJM2'  JU  6f“ 
lj£l_y*h  Oj^lS  u1  c?2iJ'  A?£.'j(*2l  dcJ^cy^  <“2J 

jl  JIj-jI  c-l^T  jjl  ,(»t*Lj|(_^<_J  0(j^al^JI  pljjl  S Jiji^JI  jj£i_J 

U^lS  f>J  l^l.f“2l_j|(_>j^l_l  a^lj^JI  j>ljjl  S JjSg-Jl  Jj(j 
lo ^lijjjl  ejl^  (_£C_i  jl  ^iL_jl(_ju£<_J  a<j-al^  Jl  J  J  j'  OJtja^J' 
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<-%'  a?  ^ jcAJJ  jal jf  m jii'  jf  jd'1-^ 

->£  m'i_>j1cJ”.AS 


1 9.  Ar  abicScheduling#V  oiceV  erification 

a.  Description 

Simulates  the  NCA  voice  verification  process.  This  process  asks  callers 
for  their  10-digit  account  number.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicScheduling#ArabicScheduling 

ArabicScheduling#ConfirmAccountNbr2 

ArabicScheduling#ConfirmAccountNbr2 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

fljji  S Jjri 

Details: 

VoiceVerification_init  ». J'c-2'  Jj'  u?“ 

Entry  Type  =  reentry 

Details: 

VoiceVerification_reentry  Jjj  j'  J'c-2'  s-%' 

e.  Grammar: 

Arabic  Sc  he  duling_V oiceV erification.gsl#GetAccountNumber 


NL  Slots 


V  allies 
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<  Ac  countN  umber> 

”[ten-digit-string]”,  J- 

<digit_one> 

j'  ,-^J 

<digit_two> 

^  ,-^J  ,Jt—flO-£a 

<digit_three> 

^odiliJCj  ^  (_^dj  ?o 

<digit_four> 

^  ,u'l>— ^  » J^L^3 

<digit_five> 

o^-^Cli  ^oCi^  ,e^S->  j'  ,0^'J1^-1  ^  ,-^J  ?JLJ‘->a 

<digit_six> 

o^-^CIj  ,0^4-1  <jjj  ^  ^'u1—5'  ,-^J  ,Jt—flc>£a 

<digit_seven> 

o^-^Ci  J  ^'u1—5'  ,-^j » J^U^3 

<digit_eight> 

o^-^CIj  ^  ,a^Jdj 

<digit_nine> 

o^-^cli  ?a^jl^CLi  ^  ,u'l>— ^  ,-^J  »  J^L^3 

<digit_ten> 

^lj  5 ^o^-L—s^  ^oCIj^  ^oC1)I(Jc!j  9^jl(jdjl 

Sample  Phrases 

Slots  Filled 

<digit_one  »(/l>V-^> 

C  ~  C  ~  _  - -5" 

<digit_two  olSuV^ 

<digit_three  ®lSuVl-j> 

<digit_four  °^?r> 

<digit_five  »ofj;> 

<digit_six  ®ijjec> 

<digit_seven  -^' j> 

<digit_eight  u'i>^'> 

<digit_nine  -H j> 

<digit_ten  u'u1-^ 

<AccountNumber  ®>c5o V1— 0‘t# lj 'e1— j- °c5o'f c-j- “o^fC _ _ °<->“eC _ J- 

>u'u‘— ^ 

”dtmf-8  dtmf-8  dtmf-8 

<digit_one 

dtmf-5  dtmf-5  dtmf-5 

<digit_two  f>^J>»L5u' 

dtmf-1  dtmf-2  dtmf-1 

<digit_three  ®lSuVl-j> 

dtmf-2” 

<digit_four  «ofC> 

<digit_five  »<_>“?£> 

<digit_six  »ofC> 
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<digit_seven  -^} j> 

<digit_eight 

<digit_nine  -H  j> 

<digit_ten 

<AccountNumber  831-869-9638> 

/• 

Actions 

Condition 

Action 

Goto 

Details: 

Generic_thanks” '  jAA“ 

Assign:  AcctNbr_a  =  lastresult$. interpretation. digit_one  ArabicScheduling#Confir 

mAccountNbr2 

Assign:  AcctNbr_b  =  lastresult$.interpretation.digit_two 
Assign:  AcctNbr_c  =  lastresult$. interpretation. digit_three 
Assign:  AcctNbr_d  =  lastresult$. interpretation. digit_four 
Assign:  AcctNbr_e  =  lastresult$. interpretation. digit_five 
Assign:  AcctNbr_f  =  lastresult$.interpretation.digit_six 
Assign:  AcctNbr_g  =  lastresult$.interpretation.digit_seven 
Assign:  AcctNbr_h  =  lastresult$.interpretation.digit_eight 
Assign:  AcctNbr_i  =  lastresult$.interpretation.digit_nine 
Assign:  AcctNbr_J  =  lastresult$.interpretation.digit_ten 
Assign:  accountNbr  =  lastresult$. interpretation. accountnumber 
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g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

“O^'cJ'  jj'  » JO^J'  Jjj  j'  J'£j' 

jj^i—i  f>J  til 

oJIj-  (_5* — i  (ji-i  ji  Jl  jji 

Jf“  Lr1  jj'  'a<Z.U Jj*  ttso'AS1-* 

JlS^O^J'  J^'  Uf  J3 JcAJJ  .ASJ£ 

Continue  with  rec  in  this 

state. 

Details: 

VoiceVerification_error  j'  J'<j-'  Jj  jJ'“ 

f>J  lit  “o^'cJ'  “ ju^;J'  Jj  j 

Jl  p' jj'  » Jl>%J'  cAj? 

jJI  tla(jbji_i  ojl^  (ji— i  (ji— i  jl  ^bli—i '(_>*£;  i—i 

Jjr'  (jf»  nil JjiJJ  jtSl Jf>  M  jj'  %£' Jf 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

nu-a'^J'  f>' jj'  » JlV^J'  Jjj  j'  J'ij-2'  el^fjJ' 

» jd%J'  ^lej (ji4 <_£  j»J  'i' 

sjlj-  <ji_s  ,ji_s  ji  0(_>al^  Jl  f>l  jjl 

jbl Jj*  Lr1  jj'  Jj»  n'jr  jJ'  I'njbj1-* 

J  Jl/^O^J'  Jj'  (jf>  nil JlAJJ 

Continue  with  rec  in  this 

state. 

Details: 

VoiceVerification_error  j'  Jlj;-'  JjfjJ'" 

fj  'J  .(“-^‘-r1'l_>“£‘-7J  “J^'cJ'  jj'  “ JU^J'  Jjj 

J'  <»' jj'  ju%J'  ilAs 

n  W  jJI  ilojhjji-j  ojl^  (ji— i  (ji— i  jl  ^iili_il(_jo^;i_J 

Jj'  (jf>  “I3 juiJJ  jtSljp  jij'  %£' jp 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

(jJ^-  i_i  SlsJ(>J;  (J1— a  c-Ji-jJI  J^;i  <ja 

nj-3'^'  (“' jj'  » J(J-j;J'  Jjj  j'  J'^'  e'jr'jJ'  ‘^“JO-mJ' 

Continue  with  rec  in  this 

state. 

131 


lAs  fJ  Ijl 

ti_>“£M  jal jj»  v jJI  Sg^t jj>  jJI  ‘lojhji—a  “Jc  j' 

•  •'\?JE  lTJ'c>“C‘-^  d/EO*-^  J^l  jp  aL J(_)ijj 

Details: 

VoiceVerification_help  “t/d’t.  l?1-*1  Jj;1  c>“ 

ji  Jljol  al^‘jJI  ‘Cljjjj^aJI  I Jlj^  ‘—a  jg^CjJI  fUajjL-J 

lil  »<>al£  JI  j»l(jjl  S Ji_£gd'  djj  jj^-l—1  j»J 

i  lo^jl  ojl^  (_£c_a  jl  ajj-al^ JI  fljj!  aj(_>u^JI 

dt/^O^J'  <jf  da JlAJJ  jd Jf>  M JLT  “g^1 Jf>  jJI 


20.  ArabicDetaineeAppt  Page  Information 

a.  Description 

This  page  demostrates  the  call  flow  for  a  detainee  appointment  scheduling 
application,  no  interaction  with  backend  database. 

b.  Page  Variables 


Page  Variables  Table 

Name 

Initial  Value 

Description 

DetaineelSN 

DetainNbr_a 

DetainNbr_b 

DetainNbr_c 

DetainNbr_d 

DetainNbr_e 

DetainNbr_f 

DetainNbr_g 

DetainNbr_h 

DetainNbr_i 
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c. 


Call  Flow 


21.  ArabicDetaineeAppt#ArabicDetaineeAppt 

a.  Description 

Ask  callers  if  they  would  like  to  schedule  a  new  appointment  to  visit  a 
detainee  or  check  to  see  if  a  pending  appointment  is  scheduled.  (This  is  a  recognition 
state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicS  cheduling#NbrCountV  erify 

ArabicDetaineeAppt#CheckAppointment 
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ArabicDetaineeAppt#New  Appointment 


d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

jf  J lit :  jcscsJlejJI  y  q?  «■'£  jJI 

lSMOY  ijf  UjAj1— 1  4jl3  4^ jJ''— i 

j'c5  jJJ  (JMOf  j£. J(*“  :  J. Jij  0 j'<_S  jJJ 

Details: 

ArabicDetaineeAppOnitLS'-^c'J  jJ'“  : u_s jc'  M*  j' 

j.dijil  lil  l(,l  Jj (j  c- W jjli— a  -r  (JjJjlIi  lil 

LjMLt'v  : Jjdj  jJ'Ai  o jJJ  of*  jjjjCj 

”.”»  j'l£  jJJ 

e.  Grammar: 

ArabicDetaineeAppt _Arabic  Detainee Appt.gsl# Arabic  _Rule 


NL  Slots 

V  alues 

<userlnput> 

newAppoinment,  checkAppointment 

Sample  Phrases 

Slots  Filled 

Jf  Of 

<userlnput  checkAppointment> 

”» j'lS  jJJ  Jf” 

<userlnput  checkAppointment> 

<userlnput  newAppoinment> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

(J6 

ArabicDetaineeAppt#Che 

serlnput  == 

ckAppointment 

“checkAppointment” 

Details: 

GeneriC-Sure’Tuj-^'y  fAj'  J»“ 
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lastresult$ .  interpretation,  u 

ArabicDetaineeAppt#New 

serlnput  == 

Appointment 

“newAppoinment” 

Details: 

Generic_sure”?(jj.ii]lcjj»  J»“ 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

131  f.\^ f*— 1 

jjjijdj  131 1^1  :  Jj(j 

^ o j\(j  jJJ  u? 

jJJ  <JM  ^ 

Continue  with  rec  in  this 

state. 

Details: 

ArabicDetaineeAppt_error  f>Mj^ 

:  Jjj  ‘  Ji/Jjr  Jf>  dp£  UJJ J^ 

Id  l^i  jg-  tjf*  -dl  J-Gl 

Jgg Jf“  1  jJ 0  jIl?  jJJ  Jf“ 

”.”•  jJJ 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

djg  ‘G. df£  UJ-C1— 1  (*-*£}£ 

jjjjCii  til  lj»!  g-^-7r  -g'  jd '  ;  JjJj 

l5 jJJ  up  'jJjj1-* 0 j' 

.”»  j'cS  jJJ  (Jhr*L>Y  Jgg Jp“ 

Continue  with  rec  in  this 

state. 

Details: 

ArabicDetaineeAppt_error 

:  Jjii  jJ'1-*  ‘A Jg; jp  dp£  <jjJ j1-^ 

rjf  Jtiiicjd'  ljl  l^al  Jg- 

1 JMU'p  Jp“  '  jJ  JJ1-*  *  j'l£  jJJ  LjMLPf  Jgg  Jp 

”.”•  jJJ 
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h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

tjjJjdi  lil 

jjjjdj  lil  :  Jjj 

elj “ j'cS jJJ  Uf* 

jJJ  JMO'f  ^ Jf““  3 JiJ 

Continue  with  rec  in  this 

state. 

Details: 

ArabicDetaineeAppt_help 

jf“  :  J jij  jjJ 

-r  Ijl  1^1 

l JMOY  Jf““  Jjl3  e j'lS  jJJ  dSM_>Y 

”.”•  jJJ 

22.  ArabicDetaineeAppt#CheckAppointment 

a.  Description 

(This  is  a  non-recognition  processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#ArabicDetaineeAppt 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

d.  Actions 


0 

Action 

Goto 

- 

'J  o'1-* 

CleanUpAndexit_sayGoo 

dbyeArabic#sayGoodbye 

Details: 

CheckAppointment_init  'J  O'1-*  ‘-r1L>“c“ 

'iO1-*  sjjlg-c  jjl 
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23.  ArabicDetaineeAppt#CheckDetaineeISN 

a.  Description 

This  process  simulates  interaction  with  a  back-end  database.  It  is 
envisioned  that  the  inputs  to  the  database  are  the  caller’s  account  number  and  detainee’s 
ISN.  The  database  will  then  match  the  two  numbers,  if  the  database  confirms  that  the 
caller  is  a  registered  visitor  of  the  detainee,  the  database  will  generate  a  voice  recording 
of  the  detainee’s  name.  If  the  two  numbers  do  not  match,  the  system  will  return  a  prompt 
stating  that  the  caller  is  not  a  registered  visitor  of  the  detainee.  (This  is  a  non-recognition 
processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#ConfirmDetaineeISN 

ArabicDetaineeAppt#RecordVisitationDate 

d.  Actions 


Condition 

Action 

Goto 

- 

(»l3J  jls'  j  lil  lS j'  </< ‘  'ul^C 

ArabicDetaineeAppt#Rec 

File  Expression]  [File  Expression]  [File  Expression]  [File[ 

Expression]  [File  Expression]  [File  Expression]  [File  Expression] 

[File  Expression]  [File  Expression]  [lOOOmsecs]  u'J' 

.O^'c  “t/J0  (NJJ  '  JL s'  j  f“d  (ji 

’VjIJjjJ' 

ordVisitationDate 

Details: 

CheckDetaineeISN_initPartl  ' jls1  j  ^  ls J  lsujJ;-1 

” J6  f“c3J 

File  Expression:  ’’numbers/”  +  DetainNbr_a  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_b  +  “_high.wav” 
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File  Expression:  ’’numbers/”  +  DetainNbr_c  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_d  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_e  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_f  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_g  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_h  +  “_high.wav” 
File  Expression:  ’’numbers/”  +  DetainNbr_i  +  “_high.wav” 
Silence:  1000  msecs 

CheckDetaineeISN_initPart2  *' jls'  j  <jVJ' 

”.l j“  ftij 

DetaineeName_Arabic””c5 j'lijjJ'  jm'”“ 


24.  ArabicDetaineeAppt#ConflrmDetaineeISN 

a.  Description 

This  process  asks  callers  to  confirm  the  detainee’s  9-digit  ISN.  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#EnterDetaineeISN 

ArabicDetaineeAppt#EnterDetaineeISN 

ArabicDetaineeAppt#CheckDetaineeISN 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

File  Expression]  [File  Expression]  [File  Expression]  [File[  — Jo 

Expression]  [File  Expression]  [File  Expression]  [File  Expression]  [File 

Expression]  [File  Expression]  Jjr  jjl^-j  ‘’'clSco-3  '3  u'ai  '3  3° 

JjJ  ‘  cAs  f“J  ■”?<co“  JjJ  .”U“ 

Details: 
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GenericPromptConfirm_partl”^^L>“  J»“ 

File  Expression:  ’’numbers/”  +  DetainNbr_a  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_b  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_c  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_d  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_e  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_f  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_g  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_h  +  “_high.wav” 

File  Expression:  ’’numbers/”  +  DetainNbr_i  +  “_high.wav” 
GenericPromptConfirm_part2  3° 

GenericPromptConfirm_yesNo  .’V^u“  Jjii  ^  '3“ 

Jjj  jcJli-a  lio 


e.  Grammar: 

Arabic  Detainee  ApptConfirmDetainee  I  SN.gsl#ArabicRule 


NL  Slots 

V  alues 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”IJ” 

<userlnput  no> 

<userlnput  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretations 

serlnput  ==  “no” 

l,ji 

Details: 

Gcneric_imSorry”!iA>' 

ArabicDetaineeAppt#EnterDetaine 

elSN 

lastresult$ .  interpretations 

serlnput  ==  “yes” 

ArabicDetaineeAppt#CheckDetain 

eelSN 
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g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  = 1 ) 

nomatch  noinput 

maxspeechtimeout 

10  URL[  <J(5£i_KJsj  (\ij  o'*0 

Expression]  Ojr 10  o1^  '0 

‘  'c^C1-^3  O'OlS  f“4  J jj 

,”U“  J jij  jJi*— “ 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmDetaineeISN_error  fiij  u'^  '0“ 

URL  Expression: 

genISNumberfDetaineelSN) 

GenericPromptConfirm_yesNo  10“ 

fj  10  JjO  jJ'1— *  ‘ 

”.”U“  Jjc3  ‘  cAf 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

1  (j^  til  URLf  Oc/^o^J's-1 

Expression]  jd'1-*  ‘  O1^ 

‘  'c^C1-^3  '^3  O^ls  t“4  10  Jjti 

,”U“  J j(j  el^  jJI(— a 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmDetaineeISN_error  fij  0'O  '0“ 

3lSJ6J' 

URL  Expression: 

genlSNumber(DetaineelSN) 

GenericPromptConfirm_yesNo  10“ 

j>J  io  -’V&ij'1  <Jjl3  4jr jd'1— *  ‘ 

”.”IJ“  Jj(_3  <0^ jJ'i-a  ‘  OAs 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

o3  Of  (_sO£.J  4'  fjj  “C 

URLf  fdj  jd'  u'^  '4  .0l5£l>"J'‘tj 

Continue  with  rec  in  this 

state. 
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Expression]  djr  jJK-i  '-1' 

‘  Lo  ilAf  f»J  LI  ■”?'C‘j“  djCS 

.”U“  Jjj  jJt'-j 

Details: 

ConfirmDetaineeISN_help  lsuLj“ 

H  .UlS^L^J'S-1  “lSJgJ'  (*l3J  “C1-^3  M* 

(jliil’yj'jJI 

URL  Expression: 
genlSNumber(DetaineelSN) 
GenericPromptConfirm_yesNo  u'1^  Ll“ 
i»J  lil  Jjj  jc!t<— «  ‘  L° 

”.”IJ“  Jjj  ‘  lAs 


25.  ArabicDetaineeAppt#EnterDetaineeISN 

a.  Description 

This  process  asks  callers  to  enter  a  detainee’s  ISN  to  schedule  a  visit. 
(This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#New  Appointment 

ArabicDetaineeAppt#ConfirmDetaineeISN 

ArabicDetaineeAppt#ConfirmDetaineeISN 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

fd  j!  JjJj  jJI 

Details: 

EnterDetaineeISN_init  fljjlJI  jl  Jjj  ^ jJI“ 
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Entry  Type  =  reentry 

'J'  ftLW  j'  Jjtjj  s^lgd  jJ'  .lSu 

Details: 

EnterDetaineeISN_reentry  “■%'  J*  <-Jjl3  »■%'  «■'£ J(J'“ 

e.  Grammar: 

ArabicDetaineeAppt_EnterDetaineeISN.gsl#GetDetaineeNumber 


NL  Slots 

V  alues 

<DetainNumber> 

”[nine-digit-string]”, 

<digit_one> 

,&(_£(jl^eLl  ^odl^JjJ  ?odlltJdl  ?^”l  j  ? 

<digit_two> 

,&(_£(jl^elj  ^odl^JjJ  ^odlljdl  ^(jl^jCljl  j  5 

<digit_three> 

dll  (Jell  ^^jl^jdil  ?J^lj  ^  ^jjjdi  90(_£(jl^di  96^'C_itjaj  5adi(__)ji  9d^c__i _ )l  ?o 

<digit_four> 

96(_^(jl^dl  ^odl^JjJ  50(JjJ^a^  ^O^-t-Jjl  ^odlljdl  ?(jl<jtlll  ,^l  J  , 

<digit_five> 

96(_£(jl^dl  ^0^- ^odl^JjJ  50(JjJ^a^  ^O^-L-Jjl  ^odlljdl  ,^l  J  ,  .J'-Aj-3 

<digit_six> 

,o(— ,oCiIJcj  ^jjl^jdil  9^lj  ^^t—fl^j-afi^-^eii  90(_^(jl^di 

<digit_seven> 

O^^Cj  96(_5(jl^d3  ^odl^JjJ  ^0(J^a^  ^O^-t-Jjl  ^odlljdl  ^(jl^jCljl  ,^l  J  , 

<digit_eight> 

O^^Cj  96(_5(jl^dl  ^0^- ^odl^JjJ  50(JjJ^a^  ^O^-t-Jjl  ?odll(Jdl  ^(jl^jCllI  ,^l  J  , 

<digit_nine> 

O^^Cj  96(_5(jl^el3  ^odl^JjJ  50(JjJ^a^  ^O^-t-Jjl  ?oCllltJdl  ^l^jdjl  ,^l  J  , 

Sample  Phrases 

Slots  Filled 

0^  <_l(ja- D(J  j l^aCll- ’ ’ £>^ 

<digit_one  -H  j> 

<digit_two  u'u1-^ 

<digit_three 

<digit_four  jb> 

<digit_five  »ujec> 

<digit_six 

<digit_seven 

<digit_eight  “esu^^ 

<digit_nine  =^~— => 

<DetainNumber  1 
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”dtmf- 1  dtmf-2  dtmf-3  dtmf-4  dtmf- 

5  dtmf-6  dtmf-7  dtmf-8  dtmf-9” 

<digit_one  -H j> 

<digit_two 

<digit_three 

<digit_four  J> 

<digit_five 

<digit_six 

<digit_seven 

<digit_eight 

<digit_nine  => 

<DetainNumber  j- 

/.  Actions 


Condition 

Action 

Goto 

'Ijdiui 

Details: 

Generic_thanks”  1 

Assign:  DetainNbr_a  = 

lastresult$. interpretation. digit_one 

Assign:  DetainNbr_b  = 

lastresult$. interpretation. digit_two 

Assign:  DetainNbr_c  = 

lastresult$. interpretation. digit_three 

Assign:  DetainNbr_d  = 

lastresult$. interpretation. digit_four 

Assign:  DetainNbr_e  = 

lastresult$. interpretation. digit_five 

ArabicDetaineeAppt#Con 

firmDetaineelSN 
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Assign:  DetainNbr_f  = 
lastresult$. interpretation. digit_six 

Assign:  DetainNbr_g  = 
lastresult$. interpretation. digit_seven 

Assign:  DetainNbr_h  = 
lastresult$. interpretation. digit_eight 

Assign:  DetainNbr_i  = 
lastresult$. interpretation. digit_nine 

Assign:  DetaineelSN  = 

lastresult$. interpretation. DetainNumber 


g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

j'  Jjj  jd' 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

Details: 

EnterDetaineeISN_error  j'  Jjii  jJ'“ 

state. 

WHEN ( COUNT  =  2 ) 

3i '4'  -^jicA3  j'  djj  4^ jJ 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

Details: 

EnterDetaineeISN_error  j'  Jjj  jd'“ 

J'  4ljj'  -^cA3 

state. 

h.  State-Specific  Universal  Behaviors 
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Universal  Type 

Action 

Goto 

help 

“cAjA  j'  Jjijj  jJI 

Continue  with  rec  in  this 

.0 

state. 

Details: 

EnterDetaineeISN_error  j'  Jjii  jJ'“ 

26.  ArabicDetaineeAppt#NewAppointment 

a.  Description 

This  process  asks  callers  if  they  have  the  detainee’s  Interment  Serial 
Number  (ISN).  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#  ArabicDetaineeAppt 

ArabicDetaineeAppt#EnterDetaineeISN 

d. 

Pre-rec  Prompts 

Type  and  Condition 

Action 

Entry  Type  =  initial 

%s j°J'  ,\jj  A1-1 uAts  u'  m^ls  csA  J Ji  J^i  o? 

lilj  :djij  'A'jJt-i  3lSj°J'  f >(jj  j.alcj lA  .uls^lA's-1 

”'J“  :  Jjti  u  ‘As  A 

Details: 

NewAppointment_init  lsJ£,  J 4'  A'  A*  A^ JJCV  <iuAs  u'  -lSjj;  jf“ 

uls^lAA  a^'cd1  %sj3iJ  (“jj  A1"^ lA  ^  .lx^lkJ'm  l>AJ'  3lsj°J'  f >l3j 

””IJ“  :Jj(_3  j j  litj  :Jjij 

e. 

Grammar: 

ArabicDetaineeAppt JNewAppointment.gsl# Arabic _Rule 
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NL  Slots 

V  alues 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”U” 

<userlnput  no> 

"tt& 

<userlnput  yes> 

/.  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretation,  u 

serlnput  ==  “no” 

ijl  ‘  ° -A? j<-l  jp  Jp£  JjU  up 

ls1— ‘uj  .  o^^JI  Jl  pjjj  p^p  ujA? 

pjj  jJI  lio  plil^Uagd  IJ  dilel J^ljj 

“la J(_)ijj  jtSl Jp  M Jli'  “££* Jp  jJ'  .U>-*J^d' 

■piijd"j°  J^U 

Return  to  the  calling 

dialog 

Details: 

AccessDenial_init  » j'ls  jJ  AsJ£  ^ jp  Jjrl  up“ 

U-al^JI  “lSjoJI  pjjj  pid^p  UJ^lS  j'  ‘c'uE<U“d' 

UlS£Uj‘JI1tj  IJ  “ill'1-*  “LSUpU'  ^jUI JjrUJ  “JTLSAjjj  . 

jJI  -UJ1— pU  jJI  lj»  lucMlpc? 

’’■fiijJ'l-10  J^iJ  J3 juAJJ  jp  v jJ'  jp 

lastresultS  ■  interpretation,  u 

serlnput  ==  “yes” 

ArabicDetaineeAppt#Ente 

rDetaineelSN 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

U-a'j; Jt  pijj  ptSi^J u'^  Ijl 

pj  U j  ”p£j“  :  J Jl3  jJ1<— s  ol5^l>“J'‘t! 

UC  j-S  ”'J11  ;  JjJ  «1j  jJI'-j  p>A— 1  jj£M  <j-4j 

_oi«  (jJ^.  Jji_>a^JI  (_£Lj  plibjdjjjiQjji  Ijjjjl-J 

>— >'p.  jJ^pdl 

Continue  with  rec  in  this 

state. 
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Details: 

NewAppointment_error 

uAg  lit j  :  J jj 

UJUJ  ”U“  :  J jl3  e'j  jjti-i 

_oio  (_sJ^  JjlJ-^jJ'  Lf^ *  'ijjJ-V 

jjjfjl 

WHEN ( COUNT  =  2 ) 

O3' jj'  o^joJI  fjjj  (wild] jj£L_]  L)^  Ijl 

Continue  with  rec  in  this 

nomatch  noinput 

(>J  lit  j  'V&<j“  :  J  jjj  «'j  jcJl' — *  ut5Ji_>“J'‘-r! 

state. 

maxspeechtimeout 

ujuj  ”'4“  :  JjJ  «'j  jJI'-j  i jj^v1  u^ls 

_oi«  (_sj£-  JjO-^jJ'  lS1— ®  'ujj-’m 

jj£fjl 

Details: 

NewAppointment_error 

O3' j  J'  eLfJ°^  (“ijj  JJJM 

t>4_s  j>J  li! j  "f£u“  :  J jij  *'j 

ujuj  ”U“  :  J  jj  »'j  jjli-i  jj^v1 

_oio  (_sJ^  JjiJ-=jJ'  c£<-i  ftSljgMoOo1  IjjjJi—i 

jjjfjl 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

j*ikj jj£L_!  Jj^tS  (jl  mJlS  jf  lS Jj  J JiJ^J  J'  Jj'  up 

pjjj  p1-^ jjjm  u'^1  Ijl  .lx?jujJ'lt1  a-3' jJ'  “csj^J'  puj 

U^LS  (“J  Ijl J  ”pjlj“  :4 Jlj  jJI<-*  ULSJl_«Jl-r1  L)-3' jJ' 

IjjjjL-i  (j^uj  ”1(J“  :JjJ  *'j  jJI'-i  jjjm 

,^'p jJ^jiJI  ,»io  uJj  J JiJ-aj  J' 

Continue  with  rec  in  this 

state. 

Details: 

NewAppointment_help  A?Jj  jp  uJj  Jju-^jJ'  Jj'  jp“ 
lil  .lX£JlkJ'sj  u-al jj'  »l5j»JI  pAli jjiilu  <j'  MJlS 

:Jjl3  elj'jJ'i-i  Ui/JlkJ'm  U-“ljJI  “cSj^Jl  pdjj  p1-^ JJJM  u'1-^ 
ujuj  ”'J“  :  JjJ  «'j  jJI'-j  j^cj jj£L_i  j»J  lil j  ”f£0“ 
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oio  i_sJ^  dju-^jd'  lS1— ®  'ujJ-,LrJ”.Cjl|»jj£-(»JI  . 


27.  ArabicDetaineeAppt#RecordVisitationDate 

a.  Description 

This  state  is  an  Arabic  substitution  process  for  the  English 

GetDetaineeVisitation  Date  and  Time  functions.  (This  is  a  record  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicDetaineeAppt#CheckDetaineeISN 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

. jjJjCj  S jl(_5 jjl  (jf  jj  jltli  Jjj  Jj- jJI 

”lS j'djjjd'  MjcKV  J'-r1'” 

Details: 

RecordVisitationDate_init  i> jj  j <4 djti  *'j jd'  ju-^d'  jVu^  J£Lr1“ 
(jjjjcj  ^UjJI  i jGjJ' 

DetaineeName_Arabic””L? j'Jjjd'  jm'”“ 

e.  Actions 


Condition 

Action 

Goto 

- 

'us-1  1  u'  'jj ju  .“ j'ls jd'  '<jdj<_>“  Asd  ‘  ' 

CleanUpAndexit_sayGoo 

.0 JlS jJJ  24 

dbyeArabic#sayGoodbye 

Details: 

RecordVisitationDate_post  «'l u4ji“  .» jly; jjl  <-jJ1>  'uJju^  AiJ 
fCj  Ijl  a  a1—*. Jji*d  24  SJM  'uS-1  ,l— 1  u'  'jj  ju 

148 


j'lS  jJJ  J(»  A^C1^ 


f  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

QS Jjljj  jJI 

Continue  with  rec  in  this 

state. 

Details: 

RecordVisitationDate_init 

j'l? jJI  up jj  Jjii  jd' 

(jjJjCll  cSCjJI 

DetaineeName_Arabic  M^o-3?  jm'”" 

’’’Vj'djjJ' 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

j'1— 1  Jjljj  jJ' 

’’cSj'djjJ'  V^O-3;1 

Continue  with  rec  in  this 

state. 

Details: 

RecordVisitationDate_init  J£.1rj“ 

» jl(_S  jjt  Uf>  jj  £i_S Jj(i  jJI 

(jjJjCll  cSCjJI 

DetaineeName_Arabic 

28.  CleanUpAndexit_sayGoodbyeArabic  Page  Information 

a.  Description 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 
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c. 


Call  Flow 


29.  CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

a.  Description 

(This  is  a  non-recognition  processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

ArabicMainMenu#ArabicVisitInformation 

ArabicMainMenu#ArabicDirections 

ArabicScheduling#RecordReminder 

ArabicDetaineeAppt#CheckAppointment 

ArabicDetaineeAppt#RecordVisitationDate 

CleanUpAndexit_sayGoodbyeArabic#hangup 

d.  Actions 


Condition 

Action 

Goto 

!  ^ 

CleanUpAndexit_sayGoo 

dbyeArabic#hangup 
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Details: 

CleanUp  AndExit_say  Goodbye  Arabic  1  jA_A' 


30.  CleanUpAndexit_sayGoodbyeArabic#hangup 

a.  Description 

(This  is  a  terminate  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

- 

H.  ARABI CM AINMENU  APPENDICES 


1.  Grammar  and  Slot  Definitions 


Dialog  State 

Grammar 

Slots 

Slot  Values 

ArabicMainMenu 

#ArabicMainMen 

u 

ArabicMainMenu_ArabicM 

ainMenu .  gsl#S  ample_Rule 

userlnput 

information,  directions,  scheduling. 

ArabicMainMenu 

#ArabicVisitInfor 

mation 

ArabicMainMenu_ArabicVi 

sitInformation.gsl#Arabic_R 

ule 

Userlnput 

repeatMessage,  returnMainMenu, 

exitS  ystem, 

ArabicMainMenu 

#ArabicDirections 

ArabicMainMenu_ArabicDi 

rections .  gsl#Arabic_Rule 

Userlnput 

repeatDirections,  returnMainMenu, 

exitS  ystem. 

ArabicS  cheduling 

#ArabicSchedulin 

g 

ArabicScheduling_ArabicSc 

heduling.gsl#Arabic_Rule 

userlnput 

yes,  no, 

ArabicS  cheduling 

#VoiceEnrollment 

ArabicScheduling_VoiceEn 

rollnrent.gsl#GetAccountNu 

mber 

AccountNum 

ber 

digit_one 

”[ten-digit-string]”, 
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digit_two 

digit_three 

digit_four 

digit_five 

digit_six 

digit_seven 

digit_eight 

digit_nine 

digit_ten 


^odjAA  j 

,adj i(_>«  J 

^odj' JA  J 

^o^<_^dj  ^edj<_^ 

^odj' JA  ,(j1(j^l  5^l J 
^o^<_^dj  ^edj<_^ 

,0^-L-Jjl  ^fldjl(Jdj  ivjl jjljl  j 

^o^<_^dj  ^o^^jl^dj  ^edj<_^ 

^sdjIJdj  )(jl(jiiil  5^l j 

,0^-L-Jjl  ^sdjIJdj  ,  J  jJA  j 

^o^^dj  ^o^^jl^dj  ^edj<_^ 

^sdjIJdj  ^  J  jJA  j 

^o^^dj  ^o^^jl^dj  ^odj<_^ 

^odjIJdj  ,(jl(jdj ll  , -A  J 

^o^^dj  ^o^^jl^dj  ^odj<_^ 

,0^-L-Jjl  ^sdjIJdj  ,<jV>^'  j 

^©^(jl^dj  ^O^-L-JjJjj  ^odj^  ^0^<_^dj 

^O^-L-Jjl  ^fldjl(Jdj  ,  Jjcjl  ?^c' 

^o^jj^idj  ^o^cd'^dj  ^edj<j^i 


.J^O3 


,>-aL>=‘ 


,>-aL>=‘ 


.J^O3 


,>-aL>=‘ 


.J^O3 


.J^O3 


.J^O3 


,>-aL>=‘ 


ArabicS  cheduling 
#ConfirmAccount 
Nbr 


ArabicScheduling_Confirm  userlnput 
AccountNbr.gsl#Arabic_Rul 


yes,  no. 


ArabicS  cheduling 

#NbrCountOne 

ArabicScheduling_NbrCoun 

tOne.gsl#Arabic_Rule 

uselnput 

nbrCount, 

ArabicS  cheduling 

#NbrCountTwo 

ArabicScheduling_NbrCoun 

tTwo.gsl#Arabic_Rule 

userlnput 

nbrCount, 

ArabicS  cheduling 

#NbrCountThree 

ArabicScheduling_NbrCoun 

tThree.gsl#Arabic_Rule 

userlnput 

nbrCount, 

ArabicS  cheduling 

#EnrollmentPin 

ArabicScheduling_Enrollme 

ntPin .  g  sl#GetPinN  umber 

enrollPin 

digit_one 

digit_two 

digit_three 

digit_four 

”[four-digit-string]”,  j-jljdjLodjIJdj- 

,6£:mJ 

^odj'Jdj  ,  jljJA  ,  J— C'-a 

,6^L>J|'“J 

^0^^  j  ua 
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j  ? 

\  9 9oLyi^ 

ArabicS  cheduling 

#ConfirmEnrollPi 

n 

ArabicScheduling_Confirm 

EnrollPin.gsl#Arabic_Rule 

userlnput 

yes,  no, 

ArabicS  cheduling 

ArabicScheduling_EnrollCh 

userlnput 

enrollMeNow, 

#EnrollCheck 

eck.gsl#Arabic_Rule 

ArabicS  cheduling 

ArabicScheduling_Confirm 

userlnput 

yes,  no, 

#ConfirmAccount 

AccountNbr2.gsl#Arabic_R 

Nbr2 

ule 

ArabicS  cheduling 

ArabicScheduling_NbrCoun 

uselnput 

nbrCount, 

#NbrCount  V  erify 

tV  erifiy .  gsl#Arabic_Rule 

ArabicS  cheduling 

ArabicScheduling_VoiceVe 

AccountNum 

”  [ten-digit-string]  ” , 

#V  oice  V  erificatio 

rif ic  ation .  g  sl#Get  AccountN 

ber 

V1-5-1 bo*?  C -6u^c~' *OTC‘ "* -“C  'j- 

n 

umber 

digit_one 

digit_two 

j  5jLij_UJ 

digit_three 

digit_four 

1  9o£-l_jj 

digit_five 

digit_six 

,0 j  5 

digit_seven 

digit_eight 

,*^ J 

digit_nine 

digit_ten 

>1  J  , 

,6^L>J|'-J  ,oL— 

,bLLIJdj  j  jLi^ua 

^od)^ 

j  ^  jC^j-sa 

9OCl)(_}jJ 
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j  9 

,0L— 

--t-Aj-3  -°£V J 

,0L— 

ArabicDetaineeAp 

ArabicDetaineeAppt_Arabic 

userlnput 

newAppoinment,  checkAppointment, 

pt#ArabicDetaine 

Detainee  Appt.  gsl#Arabic_R 

eAppt 

ule 

ArabicDetaineeAp 

ArabicDetaineeAppt_NewA 

userlnput 

yes,  no, 

pt#NewAppointm 

ppointment.gsl#Arabic_Rul 

ent 

e 

ArabicDetaineeAp 

ArabicDetaineeAppt_Enter 

DetainNumbe 

”[nine-digit-string]”, 

pt#EnterDetaineeI 

DetaineeISN.gsl#GetDetain 

r 

SN 

eeNumber 

digit_one 

j  9  jc_fl0u£a 

digit_two 

9o£(jj*h  ,OLSu'(aL~J 

digit_three 

90(JM^£  j  9  jc_i0ua 

digit_four 

,OLSu'(aL~J 

,0L— 1 

digit_five 

J  juij-a 

digit_six 

,0L— JL>J 

digit_seven 

CjI  9 

digit_eight 

?odj HJJJ 

digit_nine 

9^\ J  ^  jC^j-sa 

,ol— jL>j 

90 j  5 

,°^SJL>U  ,0L— JL>J 

J  ^  jC^j-sa 

,odj 

CjI  ?^|j  9 

,ol— jL>j 

j  ?  jc_fl0ua 

,6(*— 1 

ArabicDetaineeAp  ArabicDetaineeAppt_Confir  userlnput 
pt#ConfirmDetain  mDetaineeISN.gsl#Arabic_ 
eelSN  Rule 


yes,  no. 


2.  Prompt  List 


Prompt  File 

Transcription 

help_universal 

”.»Jgdopd'  i 

operator_universal 

’’.p^U^'uPpd  (jj -Sj£j  jO^d  'uj'^U^'  d jMli  J  d'” 

global_errorl 

”1^1  \J” 

global_error2 

— ill 

global_error3 

j'  p^Up  '-5£ UU  .“(/tjoj'  Uj'Mj^U^d'  “j'jU  'uj1  '‘Ajd  'o'” 

”.c9c'd  lS1-*  'u£p  ' jd j'^O 

ArabicMainMenu_init 

<^lp. jd^p  i_sd^  J jo^dd  ^JIoJI  Ol Up  -Af'-’c'd'  jd'” 

SO ,jj  JjO  pOjiil  tit  lj»i  “  Jjj  slj- jJIO  16 jj's-i 

ijjp  i_$d'  dju-^jd'  UlS  J^3  Smu^Uu's-1  .’’dju-^jd'  JlS  djii  jd'1-*  'u£ 

”.”J£jp  djijj  e'jr jd',-*t(!>d'd'  dc^U^^d'  d'p^MjJJ 

Generic_sure 

ArabicMainMenu_help 

Ol -j'^Cd'  Up  j't/1— 1 i^ijl  pliljllilpO  j^JIJI  dt/^UpOlJI  fUaj  jv1^” 

djo^d'  uj-^jU-1  pMj^  'j'  :»(/(J'oJI  i6 jJIlj 
dju-^jd'  jL  so jjjjO  tit  lj»t  ,’O'pjd^p  “  :JjL3  slj- jJIO 

'p'.”Jji>=jJ'  uLs j^3'1 :  Jjii  jd'1-*  ‘^'do^'dd  jui jf  csJI 

dc?£U1‘-U :  JjU  «'^ jJIO  JiJI  jiUaj  d'p^MjJJ  Si-j^jJti-j 

””j£jp 

ArabicMainMenu_error 

dju-^jd'  jlS ji>  csJ^.  djo^d'  J6”  p'  JOjpd'  'i»  csd' 

:d jj  »'£ jd'  ‘Otfi jjj-p  ud^  d ju-^dd  ?t/d'd'  dt/^o^d'  pU=L)  d'p£0<jJ 

<_sd' d jd'  lJl? j^3  u£.  “U'p jd^p  csd^  d ju-^dd  .’O'p jdj;p“ 

d'p£0<->“'d  Si—ijjjujjti—i  l^i  .’’dju-^jd'  tjy; ji =>“  :JJ(_3  elj-  jJIO  £jjpd'  'j» 

”.”J£jp  dcs^o^o11  :dji3  jd'1-*  ‘csd'd'  dcS^ijOjJI  pU=>u 

ArabicVisitInformation_init 

pjLS  Up  'JlTJUJ  ^'du^'dd  Jp  lS UU^'u^pd'  6 jl(_;  j  Olj-I^” 

0^'ukJ'  As'j^d  '^'l-rJ03  “Up'^d'  6^l(j6jl  jjji  iO-j^JI  <_S(_J1  uuL5U^-1'd' 

pi  '  6j^  eie  (_£(_)'  ^IpO^iJI  J  j- jO  Je  .  j&laJI  -IJ'-.-J  6^-i—jljtJI 

IjjjUlO  lit  jd'  “pLs'tSd'  iid'  6Jj^- Jt  uj-^jU-1  L?'  Lffd'  ,% 

’’.^dl  Ls'Ue.'  J1  ’’v'du^d'  £p“  djj  jd'^j  u '  ,spJC 

Arabic  VisitInformation_errorAndHelp 

(jJI  ^1  ^ 1  S Cil^jJ^^JI  oio  (_^jl  ^ I^Clijj^iJI  QjdtjCli  Je” 

jJ^-CoCo  Clil^jJ^  ciJ^l  jJ' 
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jp  Jgd“  : Jjti  jJkj  » jJIs-1  i_sJI  lil  1^1  jc  1 » 

lil  1^1  jjt  opisljJ” :  Jju  «-'c ‘%£u-“l$Ls jJI  vLs'JJ' 

’’.Ja^JI  jljj-l  jl  ”»plJu«JI  £p“  JjJj  *1^  jjbj  pbkllj»Jllilj»  (jp 

ArabicDirections_init 

lS1-*  jIj^i— i  SulSA  S-1  jj;  'tJcSf  20  S-1  csJ^.  ^Ui>=UJ  -il^S-1  34 Jp 

jm'  “Ul£jP  J<U“JI  lSlS jWJI  lsJ^:  Is-1  Ijo^CjI  »u</Jp  up  .S-1 

CJLs  .sa?J£  js-1'  <jJ'  9  pjjj  cjcaI1  'j^C  ”'4/p 18  S'-alu^.J  6  pjjj 

‘jU j  .9  piij  c jcpJ  s-1 j£  s1  juc  uoJcsp  <_sJc  j;U(_k>UJ  ^I-^m  3^ jp 

0-jS  J'  (jjJjCj  j»l  (_5  jS  1  s  J-jjjaJI  1-0  (_$JI  JjU-^jJI  U-0  J^3  ^IpCS  J6 

is jJI  ‘pis'csJI  lsJ'  jJ'1-*  pbicii^JIbl^  <jp  ^dj^ociijl  lil  Vo^u^ 

’’.-^cJ' 

ArabicDirections_errorAndHelp 

S J£-j“  :Jj(j  «.l^  jjlcj  (_£ j£l  S Jjj_>ajJI  JO jL  ^lpi_>“  jjjjdl  pdl(jbl  lil” 

Jjij  _jJI' — a  n$Q*q;i£ jJI  opis'uJI  L sJ'  °A£J'  ujAs1^  p1— Ju4  lil  Ipl  .”lS JC  1 
Iblp  up  pOju»Oj,jl  lil  Ipl  SlS jJI  °pLs'u3sl'  “  ^.p**  Jjijj  *'c  jJI1-*  pbi^pJ 

Jl  [jljj^l  ji  "opIJu^JI 

ArabicS  cheduling_init 

1  jujbldj  ,jl  p4_sJc  ■— >c<3  ‘lsJIJI  Jls^us^JI  pd=>u  pl-2cl-A>'1l  Jjri  up” 
lil  V^liiuJI  li“  ,'l3Sji>“p  p^Jju-1  J°  .pd=  uJI  li°  U'-i  IlSSjOj1p  UcsJ^cSp 

Jjij  <d£ jJ'l-i  lsJIJI  JlS^uS^JI  pd=u  'i3-r1UJ,p  P^J^US  AS  p'-bjOl 

lil  ,”p&u“  LS  Ji  Jl  Jl£C<->“— ‘Jl  pl-^U  'iSSASp  p  OjJ  CO“  AS  IjUJ^1— 1  pJ 

lio  Ji^^iuodjJI  j>blj^lujiuuJ  IjjjO-S  UClilJ  ‘”IJ“  Jjij  elj _jJ'* — a 

”.pd=>uJi 

Generic_thanks 

’’Ijblui” 

ArabicS  cheduling_help 

Ijuj1-^^  ui  p*A# Jj;  sjjl?  ‘csJiJI  JlS^us^JI  pd=u  p'^^u-1'  J^i  up” 
diubl  lil  .plJ=>uJI  li»  l^<-s  IJs-^uSp  UL^J^LSp  pO=u  ItisJuSp  p^J^LS  As  p 

pdij^u^  J(_3  IjUJ^l^  pJ  lii  Ipl  ■”p&<i,<l  JjcS  c-lj jJI^-i  1/JiJI  JlSJlS^JI 
'ulJJ^SJ  UCOJ  ‘”IJ“  JjlS  frlj;  _jJI‘ — S  (_5  Ji  Jl  JlS^uojCIiJI  jillau  LS'-i  IjS1^  p 
”.pd=>uJI  'i°  U^i  Ju^U--o-J J'  a  'u-uu- 

ArabicS  cheduling_error 

Jl^;  cS'-ij  ■”p&s,<‘  JjcS  »lj  jJI^-i  lu&p  lXS J^uS  p  pMj-^  'i'”  IjUJ1^1— 1  pJ  “ 

c?1-*  p^^'u^uls  Iujj-^sj  ucoj  ”'J“  Jjcs  «'c jJ'1-*  'uCp  ut^Jcss  p 

”.pd=>uJI  'i°  LS'-i  JlSCcS^J' 

VoiceEnrollment_init 

^  f^uS-3  u” 

f  J  S Jj(i  j' 

s_l  Jl  o ^Cj jJI  tlojbji— fl  Sjl^  — fl  j' 

”.  ^ V3 Jl3' 
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V  oiceEnrollment_reentry 

V  oiceEnrollment_help 

i_sJ'J'  AS^'jf  J'  JlS^iJ22-2  f^OS-1  f^JcS^iJ31-2  3L?Jf£.  ^mJ'  J^'  Of” 
OjAg  o'  't’J LS  J'i^-2'  Ojr'jJI  fj-a'^J'  0 f-^kj jjC'-H 

» ju^J'  jj^'-r2  O2^  f J  '  j.f^M'ij^cv1  “o^'cJ'  f'oJ  3 jj-“£J'  JjJ  j' 

jJ'-— 4  'a jCjj(3—4  f-^o'  ®J'^  (J‘ — 4  j'  ftA-jl^^L-j  oj-^'^J'  f'jjj' 

’’OlS-2^  l-r2'<J“cJ  Jt/EO31— ’J'  JjJ  Of  JcAJJ  j2^ Jf  ‘t2 Jlj' 

V  oiceEnrollment_error 

i_sJ £•  I_a  o^Jf^ 

’’.f^S^O^M  jdjji  i jj^J'  Jjjj  j'  J'^-2'  OjJjJ' 

Generic_imSorry 

l(jl” 

Generic_great 

’’•VC” 

NbrCountOne_init 

djIJdj  t9  <jd'  1  jf  f^jf  j'  ‘f^J  df£  ‘-fe'  jf” 

^JIJl  fUajJI  O^JIClCa^ 

f^jf  °c£ ^'f jJ^fJ'  j£.  f4J'(_>*0  ^JJ-" 

^Jl  jf 

(*l3J  l£l)^  iakliljcj  itjl(jdilt^lj  ;ljk*]o  c9  (_£l)1  1  (jf  J  &  Jf  4sl)^ 

NbrCount_help 

J  LS^jcf3  Jf£  Jj'  Of”  “-^'j  » Jf  ‘,J'£  >jJl>‘32t2  -^J'  “'jfjJI  ‘f2^ 

”.^0“-^  ftjj  l_$J'  “’‘OiIJOj  ‘O'O^'^c'j  ; lOtSlo  i9  ,_jJI  1 

NbrC  ount_error 

4  jl  jdjU^lj  Jiiilo  t9  (_$J  1  (Jf  ® Jf  *1^  J(jl” 

cadjIJdj 

NbrC  ountT  wo_init 

”V4Ji_P»- o  Of  lsjc'  -jc'Jj” 

NbrCountThree_init 

”?fl^J(_>iaLj  (jj.  (_J jjy  S  Jj.” 

EnrollmentPin_init 

O^fL?  LS^J' j  f-^JcS^lJ32112  jf jJ  f'tjjj'  3£.2r1  j'J'  J^O  O'j  .“c'c1^1  0c0” 

Of  J  jJI  .f^lj  li>JI(_>J  jl  cSCjJI  lo 

".f'^Jcs^iJ2'^  jf  jJ  f 'ijj'  ^s-1  j'J'  j'  J jij  *'2; jJ'  f2^ 

EnrollmentPin_reentry 

*'2  jJ'””.lS  j^  ' jf  f^JcS^^1-1  jf  oJ  f'ljj'  j'J'  j'  J  jJ 

EnrollmentPin_errorAndHelp 

’’.f'^Jcs^i-^'-1  jf  jJ  f'Jj'  ‘t.1^2  j'J'  ^lP3  j'  J  jJ  *'2  jJ'” 

EnrollCheck_init 

lio  ijJ^  *-4  J^  ^>J'  fdaOM  f^J^O^O  f  J  'OO'  'j-^ls  ‘O'J'” 

LS J ^  0^.  ^JlJ^J'  M^'j^3  LsJt  ‘-4  J^^J'  Of  'O  0-^fLSL>“  f^.OJ'  . ‘-2J(J-3J'  J 
j'  LS  Ji_kJ'  f(jjJ'  Jl^-2'  iiiiS  ji3  Of  „3L£  J'  5;^-4  jOjlillj  J-  j(jjii  j1=>J'  ,»j» 

j»  jf  J  '0^.f  Jc^^o3*— 'J'  f^LsJj;  Oj2^  ‘-^jij2  3c3l5  ji>J'  .ojos-i .  jl>“J'  “fJ1-^ 
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EnrollCheck_errorAndHelp 

NbrCountVerify_init 


NbrCountVerify_post 


NbrCountVerify_help 


RemindDate  init 


RemindDate_post 


RemindDate  error 


RecordSecretDate  init 


RecordSecretDate_post 


RecordSecretDate_error 


Voice  Verification  init 


V  oice  V  erific  ation_reentry 


V  oice  V  erific  ation_help 


Voice  Verification  error 


Idcsdd  jlaJI  oio 

”.'’LSud£0““  :djd  jJ  ‘I jj1-*  dt/co^dl 

:djd  jdl  d^d” 

‘9  i_sdl  1  <jf  a-^lj  » jf  jdl  .sdicjdd” 

^dj  iodilddi  j  ;lido 


’’.All (jf  J  1|_3'  f1— 1  Ajd” 


dicAjd”  1  oJ^jj  o Jl  ifndili^o^CAA  J 

Jl  lodilddi  ijljjdjli j  ;lido  <9  (_5 Jl 

^d^l^lllljjj:  lS*— |JI  0<_£ Ji_kJI  Ijjidicljelj  (jl  j»d(jd^(_£  J»  ‘  Id^ J  ‘  j'd'” 

tyjiljl  djd  d^  jd'  -lS  jlxJI  J^Jf“dl  j^ie j 

I^Vla  lod^c^jcA  Ijjj 


lsJ^  ‘-i  iJ'-*  cfedA-1  Add  ‘  *dc>“c” 

’’.^jo^d' 

^dj^l^dl^  LS^-ldl  »LS J(_kJI  “fdddl  L^d  Ijdjld1—1  d'  f^U'dfLS  d°  ‘  ld^  j” 
^-dA  j'  lS  jo- j'  -A  j^d'  jdidi 


(“ddioAj  ‘— *jlAJ  6l£  jc>“d'  Ajl^jdj^dl  csd'  ddMju  t-ij^  iojL^dl  .»i»  lS'-s” 

A-^cA^lSJ  1  d^LAcS  £<_£ J^1— “-A  dd^Aj(_£  joj  ijliJLl^dl  d'iO-d' 

dfl^d's-1  °d jd  djr  jd'  ‘UlS  jdj  ' jUJ'dAli  IfAj^  •  “Al*_i j^idl  iddj; 

”.1998  dcs jm'  jf1  d  jidl :  Id^f  lido  iOQjjidl  jd.i 


”lS ji_kJI  -^j^dl  dcS^LA^  fAli  Add  d jd(jl'’ 


”ls ji_kJI  j^dl  d jJ  d^  jdl” 


Ojj-al^dl  jdjj'  S jcA^d'  d'^d  djr'jdl  ‘^s-’dl  dj' 


di-jl^j-t-i  o^l^d'  (dijj'  i jcA^d'  djii  j'  d^J'  «ljr’jdf’”.f> 


idij^j-ad'  lSlS^  l-d  j^elidl  loUajL-j  “csdfj;  lS^  eJ^d'  d^i  J?” 

jd(_5  j»d  dl  0(_>al^dl  f'ldj  » JcA^dl  djJ  j' d'^-2'  *ljr’jdl 

*1^  jd'  dojbji-j  od'^  jl  f“dcr1'lJJ1^'-7J  “i.K’^dl  ^'d j'  J^*A  d'  ^dd ljj^t_j 

^  M'cAJid  dcSJcA^d'  djr'  Uf“  da jcAJd  jd i_j jji  o^jrl j^”. 


jd^  j»d  dl  “lH’IcJ  f'dji  “ jo^dl  djJ  ji  dl^J'  *ljr’jdl” 

i  I*  odl^  jl  e1j-al^dl  (o'd  J  ajt-A^dl  adc_i  j  ^_J 

'-rJlc>“cd  ddJeA^d'  djri  dj»  d=> j(J“dd  jd jf  i_s jdl  o^jr' Jf  jd' 
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ArabicDetaineeAppt_init 


?  jd'”  lV&  uj-G1^  j<_s j't/£;d'  jC  d 

Cl?  Cl jl jCi  lil  Ipl  djjj  d^ jd'G  Jt-5? 

”.”» jl(_S  jdd  L3ML>“f  Jf“  :J Jij  dj  jjt1-*  » Jl? jdd  lSMOY  J£. Jf 


ArabicDetaineeAppt_help 

|j|  ijJ  jd ' :  Jjii  d^ jjli— J  j- fMjd  dl” 

djJ  dj jJI'-i  o Jl? jdd  LSMO'f*  jf  ■^I'-lidl  uj-G-1  ^ 

Jl?  jdd 

ArabicDetaineeAppt_error 

lil  l^al  :  Jjc3  jJ'1— *  JfJ^  jj-ijCl 

(JS-’lJV  ^ J(*4t  ^jJjl3^  b jJJ  ^ U(*  ^'^J'  jjdjCl] 

j'l£  JJJ 

AccessDenial_init 

dj;'  of”  ?Jj  (jj^cs  J  m^l?  » Jl? jd  Asj£  jf  df£ 

Iu>4»l?  U  “LSUfUl  elilf.1  jjddd  s£L?Mjj  •  Ut^L^d's-’  o-d^d'  »L?J6d' 

da jd 4J Jlj  '“icz} Jf  d^ jd^  JS-1^  f“d  jd'  fd^Uagj 

’’■fijjd'de  djdd 

NewAppointment_help 

J  a^l?  A?-1^;  jf  lsJ^.  d jo-^cd'  dj;'  jf“”  °l? J°dl  fdj  oj^l; 

jcs^c^d's-1  u-d^d'  “t/J^d'  fdj  jj^M  Jd  'd  .(ji^jij^d^  a^'cd1 

ucoj  ”'d“  :d jjj  d^  jd'G  fdcj jjj-^j  u^l;  ^d  'd j  '  j£u“  :d jii  d^  jd'G 
”.‘-df“jd^fd'  .da  csd^  djo^dl  l?^ > 

NewAppointment_error 

jcs^c^d's-1  od£d'  6L?j°d'  fjj  ^eii jJCM  lil”  ”^(j“  :djid  jd^ 

”ld“  :djj  jd'^-j  Cl^iJ  f“d 

”.1— ilf-jd^fdl  ,“1“  i_sd^  dji.K’^dl  cJ'-j 

EnterDetaineeISN_init 

U^fdl  ucSJc^d'^-1  oo^^d'  ’dl  f'idjUl  j'  djij  jdl” 

EnterDetaineeISN_reentry 

^dj'd'  jl  djd  jd'”  ULS^L>“d'l-7J  “^.(J^1— ‘d' 

”.i/u&>d' 

EnterDetaineeISN_error 

”.UL5jc>:d'l-r1  ‘dl  ji  djij  jdl” 

CheckAppointment_init 

^JLS  U  »u'^  MiJ^” 

RecordVisitationDate_post 

Jl  t_jjla  loJ^L>“  -“JJ  4  '  'j^  IjJ^j-aCljClj  jl  lj^  J  j  .0  jl^  j 

”.6 jJJ  j£.f  J  24 

CleanUpAndExit_sayGoodbyeArabic 

’’Jo^lJ^Jl  .^IJtJ-^IJJ  ^iiJJI(j-£aClli J  Ijtil^jj” 

Generic  PromptC  onfirm_part  1 

J°” 

Generic  PromptC  onfirm_part2 

lis  d»” 
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GenericPromptConfirm_yesNo 

‘  tio  o-As  (“J  IjI  djJ  ^<z jd'1-*  ‘  ti»  lit” 

J jjkj 

ConfirmAccountNbr_help 

(jit*!  lit  csjijt  <j f  jailcjl  jl  ^ jl” 

ConfirmAccountNbr_error 

’’IOls-^J  td” 

ConfirmEnrollmentPin_help 

jlai  lil  ^  jjjl  (jt  jj>  jaSieiji 

dcs^o^d'  (\jj 

ConfirmEnrollmentPin_error 

’V'A/aJ  ‘d'  f\jj  old  t^t” 

NewAppointment_init 

»ls j»dt  (\jj  jj^v1  uj'A/  u'  jf»  esd^  d jo^d'  djl  Of" 

1_J  (jlal  lil  .(jc££<_Kjl‘-rJ  1>=>I^JI  UlS^iJaJIm  I>=^d'  »L5jod'  ftJJ  jj£ 

””ld“  :djii  jjli-j  O'-As  fd  tilj  ”^0“  :djj  »ljr  jdk-* 

ConfirmDetaineelS  N_help 

”fSjd t  u'^  lit  .UL5^L>J1dl'-rJ  i_K='cd'  °L5j°d'  fOJ  “CO-3  up 

ConfirmDetaineelS  N_error 

’’uu^L^d'^  i_K='cd'  °L5j°d'  f3j  u'1^  til” 

CheckDetaineeISN_initPartl 

6l5 j»  foj  dp^u  ULS£i_>“d  'd^L^f  "t j^l  j  lil  <_$ jl  1  'uu^c” 

CheckDetaineeISN_initPart2 

“Uj6  ?<ij  dp£U  lX?£lkJ  U^u-p  1  Jed  j  p*^(ji  1  o'd'  _>Aji” 

DetaineeN  ame_Arabic 

””</ j'ljjjjdl  “t1  £i_kv  JS-1'”” 

Record  VisitationDate_init 

Cklljjj-ajl  0 j(JI  jj  Q£ jltll  Jj(j  *1^  jjl 

I.  ENGMAINMENU  OVERVIEW 
1.  Application  Summary 

a.  Variable  Definitions 

Application  variable  information  is  listed  below. 


Application  Variables  Table 

Name 

Initial  Value 

Description 

accountNbr 

another  sample  variable  for  the  subdialog 

enrollmentPin 
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DATE_OUT_day 

DATE_OUT_month 

DATE_OUT_year 

TIME_OUT_AM_PM 

TIME_OUT_time 

2.  EngMainMenu  Dialog  Flow 

a.  Universal  Behaviors 

Certain  capabilities  and  behaviors  are  available  in  all  dialog  states,  unless 
otherwise  specified.  These  are  called  ‘Universals.’ 

b.  Universal  Actions 

The  ‘Universal  Actions’  grammar  is  active  in  all  states  that  have 
recognition.  This  grammar  is  typically  used  to  allow  callers  to  ask  for  help,  repeat 
prompts,  or  transfer  to  an  operator.  Examples  of  expressions  and  corresponding  universal 
NL  slot  fill  values  are  shown  in  the  table  below.  The  following  table  shows  the  universals 
available  with  the  Nuance  Voice  Platform.  These  aren’t  necessarily  active  in  this 
application. 


Universal  Values 

Sample  Phrases 

cancel 

’cancel’ 

’go  back’ 

exit 

’exit’ 

’goodbye’ 

help 

’help’ 

’I  need  help’ 

mainmenu 

’main  menu’ 

’  start  over’ 

operator 

’Service  Representative’ 

’I  want  to  talk  with  an  operator’ 

’agent’ 
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repeat 


’repeat’ 


The  following  table  shows  the  universal  behaviors  specified  in  this  application. 


Universal  Type 

Action 

Goto 

help 

Okay,  here’s  some  help. 

Continue  with  recognition  in  the 

state  in  which  the  universal  was 

Details: 

help_universal  “Okay,  here’s  some 

help.” 

spoken. 

repeat 

Continue  with  recognition  in  the 

AND  (_previousBehavior  == 

state  in  which  the  universal  was 

undefined) 

spoken. 

repeat 

Throw  the  event: 

AND  (_previousBehavior  != 

undefined) 

_previousBehavior 

operator 

I’m  sorry,  there  are  no  representatives 

Continue  with  recognition  in  the 

available. 

Details: 

operator_universal  “I’m  sorry,  there 

are  no  representatives  available.” 

state  in  which  the  universal  was 

spoken. 

exit 

Return  to  the  calling  dialog  and 

throw  the  event:  ‘exit’ 

mainmenu 

EngMainMenu#EngMainMenu 

c.  Universal  Error  Handling 

Universal  error  handling  is  outlined  below.  This  error  behavior  can  be 
overriden  in  any  given  state. 


Error  Type 


Action 


Goto 
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WHEN ( COUNT  = 1 ) 

nomatch  noinput 

maxspeechtimeout 

Sorry. 

Details: 

global_errorl  “Sorry.” 

Continue  with  state- specific 

behavior. 

WHEN ( COUNT  =  2 ) 

Sorry.  I  still  didn't  get  that. 

Continue  with  state- specific 

nomatch  noinput 

behavior. 

maxspeechtimeout 

Details: 

global_error2  “Sorry.  I  still  didn’t  get 

that.” 

WHEN ( COUNT  =  3 ) 

Sorry,  we’re  experiencing  some 

Return  to  the  calling  dialog 

nomatch  noinput 

technical  difficulty  right  now.  Please  try 

maxspeechtimeout 

again  at  a  later  time. 

Details: 

global_error3  “Sorry,  we’re 

experiencing  some  technical  difficulty 

right  now.  Please  try  again  at  a  later 

time.” 

J.  ENGMAINMENU  DIALOG  STATES 

This  section  provides  details  of  the  system  behavior  in  each  dialog  state. 

1.  EngMainMenu  Page  Information 

a.  Description 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 
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c. 


Call  Flow 


2.  EngMainMenu#EngMainMenu 

a.  Description 

EngMainMenu  enables  callers  to  obtain  visitation  information,  get 
directions  to  BCCF,  and  use  automated  scheduling  system.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngMainMenu#EngVisitInformation 

EngMainMenu#EngDirections 

EngMainMenu#EngVisitInformation 

EngMainMenu#EngDirections 

EngScheduling#EngScheduling 
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d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Please  select  from  the  following  options.  To  get  general  visitor 

information,  including  visiting  hours,  say  ‘information’.  To  get 

directions  to  our  facility,  say  ‘directions’ .  To  set  up  a  meeting  using  our 

automated  scheduling  system,  say  ‘scheduling’. 

Details: 

EngMainMenu_init  “Please  select  from  the  following  options.  To  get 

general  visitor  information,  including  visiting  hours,  say  ‘information’. 

To  get  directions  to  our  facility,  say  ‘directions’.  To  set  up  a  meeting 

using  our  automated  scheduling  system,  say  ‘scheduling’.” 

e.  Grammar:  EngMainMenu  EngMainMenu.gsWSample  Rule 


NL  Slots 

V  alues 

<userlnput> 

information,  directions,  scheduling 

Sample  Phrases 

Slots  Filled 

’’info” 

<userlnput  information> 

’’information” 

<userlnput  information> 

”uh  information” 

<userlnput  information> 

’’get  information" 

<userlnput  information> 

”i’d  like  to  get  information” 

<userlnput  information> 

’’directions” 

<userlnput  directions> 

”uh  directions” 

<userlnput  directions> 

’’get  directions” 

<userlnput  directions> 

”i’d  like  to  get  directions” 

<userlnput  directions> 

’’scheduling” 

<userlnput  scheduling> 

”uh  scheduling” 

<userlnput  scheduling> 
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’’get  scheduling” 

<userlnput  scheduling> 

”i'd  like  to  use  your  automated  scheduling  system” 

<userlnput  scheduling> 

’’appointment” 

<userlnput  scheduling> 

’’make  appointment” 

<userlnput  scheduling> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretations 

serlnput  ==  “information” 

Sure. 

Details: 

Generic_sure  “Sure.” 

EngMainMenu#EngVisitI 

nformation 

lastresult$ .  interpretation,  u 

serlnput  ==  “directions” 

Sure. 

Details: 

Generic_sure  “Sure.” 

EngMainMenu#EngDirect 

ions 

lastresult$ .  interpretation,  u 

serlnput  ==  “scheduling” 

Sure. 

Details: 

Generic_sure  “Sure.” 

EngScheduling#EngSched 

uling 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Which  would  you  like  to  do?  get 

Continue  with  rec  in  this 

nomatch  noinput 

information,  get  directions,  or  use  our 

state. 

maxspeechtimeout 

automated  scheduling  system. 

Details: 

EngMainMenu_error  “Which  would 

you  like  to  do?  get  information,  get 

directions,  or  use  our  automated 

scheduling  system.” 
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WHEN ( COUNT  =  2 ) 

Which  would  you  like  to  do?  get 

Continue  with  rec  in  this 

nomatch  noinput 

information,  get  directions,  or  use  our 

state. 

maxspeechtimeout 

automated  scheduling  system. 

Details: 

EngMainMenu_error  “Which  would 

you  like  to  do?  get  information,  get 

directions,  or  use  our  automated 

scheduling  system.” 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

With  this  system,  you  can  choose  from 

the  following  options.  If  you’d  like  to 

get  general  visitor  information  including 

visiting  hours,  say  ‘information’.  If 

you’d  like  to  get  directions  to  Baghdad 

Central  Correctional  Facility,  say 

‘directions’.  If  you’d  like  to  set  up  a 

visit  with  a  detainee  using  our 

automated  scheduling  system,  say 

‘scheduling’. 

Details: 

EngMainMenu_help  “With  this  system, 

you  can  choose  from  the  following 

options.  If  you’d  like  to  get  general 

visitor  information  including  visiting 

hours,  say  ‘information’.  If  you’d  like  to 

get  directions  to  Baghdad  Central 

Correctional  Facility,  say  ‘directions’.  If 

you’d  like  to  set  up  a  visit  with  a 

detainee  using  our  automated  scheduling 

system,  say  ‘scheduling’.” 

Continue  with  rec  in  this 

state. 
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3.  EngMainMenu#EngDirections 

a.  Description 

Get  directions  to  Baghdad  Central  Correction  Facility  (BCCF).  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngMainMenu#EngMainMenu 

EngMainMenu#EngMainMenu 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Baghdad  Central  Correctional  Facility  is  located  20  miles  west  of 

Baghdad,  in  the  town  of  Abu  Ghraib.  From  Baghdad,  go  west  on 

highway  six  for  18  miles  then  take  exit  nine  at  Abu  Ghraib.  Our  facility 

is  located  2  miles  southwest  of  exit  nine.  Would  you  like  to  hear  the 

directions  again  or  return  to  the  main  menu?  If  you’re  done  for  now, 

please  feel  free  to  hang  up. 

Details: 

EngDirections_init  “Baghdad  Central  Correctional  Facility  is  located  20 

miles  west  of  Baghdad,  in  the  town  of  Abu  Ghraib.  From  Baghdad,  go 

west  on  highway  six  for  18  miles  then  take  exit  nine  at  Abu  Ghraib.  Our 

facility  is  located  2  miles  southwest  of  exit  nine.  Would  you  like  to  hear 

the  directions  again  or  return  to  the  main  menu?  If  you’re  done  for  now, 

please  feel  free  to  hang  up.” 

e.  Grammar:  EngMainMenu  EngDirections.gsWSample  Rule 


NL  Slots 

V  alues 

<UserInput> 

repeatDirections,  returnMainMenu 

Sample  Phrases 

Slots  Filled 
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’’directions” 

<UserInput  repeatDirections> 

”uh  directions” 

<UserInput  repeatDirections> 

”i'd  like  to  hear  the  directions  again” 

<UserInput  repeatDirections> 

”i'd  like  to  listen  to  the  directions  again” 

<UserInput  repeatDirections> 

”i  would  like  to  hear  the  directions  again” 

<UserInput  repeatDirections> 

’’info” 

<UserInput  repeatDirections> 

’’information” 

<UserInput  repeatDirections> 

”uh  information” 

<UserInput  repeatDirections> 

”i'd  like  to  hear  the  information  again” 

<UserInput  repeatDirections> 

”i'd  like  to  listen  to  the  information  again” 

<UserInput  repeatDirections> 

”i  would  like  to  listen  to  the  information  again” 

<UserInput  repeatDirections> 

”uh  main  menu” 

<UserInput  returnMainMenu> 

’’return  to  the  main  menu” 

<UserInput  returnMainMenu> 

”i’d  like  to  return  to  the  main  menu” 

<UserInput  returnMainMenu> 

”i  would  like  to  return  to  the  main  menu” 

<UserInput  returnMainMenu> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation.  U  serlnput  == 

“repeatDirections” 

Continue  with  rec  in  this 

state. 

lastresult$ .  interpretation.  U  serlnput  == 

“returnMainMenu” 

EngMainMenu#EngMain 

Menu 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

Which  would  you  like  to  do:  hear  the 

directions  again  or  return  to  the  main 

Continue  with  rec  in  this 

state. 
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maxspeechtimeout 

menu?  If  you’re  done  for  now,  please 

feel  free  to  hang  up. 

Details: 

EngDirections_errorl  “Which  would 

you  like  to  do:  hear  the  directions  again 

or  return  to  the  main  menu?  If  you’re 

done  for  now,  please  feel  free  to  hang 

up.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

If  you  want  to  hear  the  directions  again, 

say  ‘repeat’ .  If  you  want  to  return  to  the 

main  menu,  say  ‘main  menu’.  If  you’re 

done,  say  goodbye  or  just  hang  up. 

Continue  with  rec  in  this 

state. 

Details: 

EngDirections_error2  “If  you  want  to 

hear  the  directions  again,  say  ‘repeat’.  If 

you  want  to  return  to  the  main  menu, 

say  ‘main  menu’.  If  you’re  done,  say 

goodbye  or  just  hang  up.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

repeat 

#EngDirections 

help 

To  hear  the  directions  to  our  facility,  say 

‘repeat’.  To  return  to  the  main  menu, 

say  ‘main  menu’.  If  you  don’t  need 

anything  else,  say  goodbye  or  just  hang 

up. 

Continue  with  rec  in  this 

state. 

Details: 

EngDirections_help  “To  hear  the 

directions  to  our  facility,  say  ‘repeat’ . 

To  return  to  the  main  menu,  say  ‘main 
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menu’.  If  you  don’t  need  anything  else, 
say  goodbye  or  just  hang  up.” 


4.  EngMainMenu#EngVisitInformation 

a.  Description 

Get  visitor  information  for  Baghdad  Central  Correctional  Facility  (This  is 
a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngMainMenu#EngMainMenu 

EngMainMenu#EngMainMenu 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Baghdad  Central  Correctional  Facility  is  open  for  detainee  visitors  from 

8  AM  to  4  PM,  Monday  through  Saturday.  Would  you  like  to  hear  that 

information  again  or  return  to  the  main  menu?  If  you’re  done  for  now, 

please  feel  free  to  hang  up. 

Details: 

EngVisitInformation_init  “Baghdad  Central  Correctional  Facility  is 

open  for  detainee  visitors  from  8  AM  to  4  PM,  Monday  through 

Saturday.  Would  you  like  to  hear  that  information  again  or  return  to  the 

main  menu?  If  you’re  done  for  now,  please  feel  free  to  hang  up.” 

e.  Grammar: 

EngMainMenu_EngVisitInformation.gsl#Sample_Rule 


NL  Slots 

V  alues 

<UserInput> 

repeatMessage,  returnMainMenu 
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Sample  Phrases 

Slots  Filled 

’’info” 

<UserInput  repeatMessage> 

”uh  information” 

<UserInput  repeatMessage> 

’’hear  information” 

<UserInput  repeatMessage> 

’’visitor  information” 

<UserInput  repeatMessage> 

”i’d  like  to  hear  the  information  again” 

<UserInput  repeatMessage> 

”i  would  like  to  hear  the  information  again” 

<UserInput  repeatMessage> 

”i’d  like  to  listen  to  the  information  again” 

<UserInput  repeatMessage> 

”uh  main  menu” 

<UserInput  returnMainMenu> 

’’return  to  main  menu” 

<UserInput  returnMainMenu> 

”go  back  to  main  menu” 

<UserInput  returnMainMenu> 

”i’d  like  to  return  to  the  main  menu” 

<UserInput  returnMainMenu> 

”i  would  like  to  return  to  the  main  menu” 

<UserInput  returnMainMenu> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation.  U 

serlnput  == 

“repeatMessage” 

Continue  with  rec  in  this 

state. 

lastresult$ .  interpretation.  U 

serlnput  == 

“returnMainMenu” 

EngMainMenu#EngMain 

Menu 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Which  do  you  want  to  do:  hear  the 

visitor  information  again  or  return  to  the 

main  menu?  If  you’re  done,  say 

Continue  with  rec  in  this 

state. 
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goodbye  or  just  hang  up. 

Details: 

EngVisitInformation_erroi7  “Which  do 

you  want  to  do:  hear  the  visitor 

information  again  or  return  to  the  main 

menu?  If  you’re  done,  say  goodbye  or 

just  hang  up.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

If  you  want  to  hear  the  visitor 

information  again,  say  ‘repeat’ .  If  you 

want  to  return  to  the  main  menu,  say 

‘main  menu’.  If  you’re  done,  say 

goodbye  or  just  hang  up. 

Continue  with  rec  in  this 

state. 

Details: 

EngVisitInformation_error2  “If  you 

want  to  hear  the  visitor  information 

again,  say  ‘repeat’.  If  you  want  to  return 

to  the  main  menu,  say  ‘main  menu’.  If 

you’re  done,  say  goodbye  or  just  hang 

up.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

repeat 

#Eng  V  isitlnformation 

help 

To  hear  the  visitation  information  again, 

say  ‘repeat’ .  To  return  to  the  main 

menu,  say  ‘main  menu’.  Or  if  you  don’t 

need  anything  else,  say  goodbye  or  just 

hang  up. 

Continue  with  rec  in  this 

state. 

Details: 

EngVisitInformation_help  “To  hear  the 

visitation  information  again,  say 
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‘repeat’.  To  return  to  the  main  menu, 
say  ‘main  menu’.  Or  if  you  don’t  need 
anything  else,  say  goodbye  or  just  hang 
up.” 


5.  EngScheduling  Page  Information 

a.  Description 

This  page  simulates  the  Nuance  Caller  Authentication  (NCA)  Process. 

b.  Page  Variables 

There  are  no  variables  defined  for  this  page. 

c.  Call  Flow 
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6.  EngScheduling#EngScheduling 

a.  Description 

Ask  callers  if  they  are  enrolled  in  the  automated  scheduling  system.  (This 
is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngMainMenu#EngMainMenu 

EngScheduling#VoiceVerification 

EngScheduling#V  oiceEnrollment 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

In  order  to  use  our  automated  scheduling  system,  you  must  be  an 

enrolled  user.  Are  you  an  enrolled  user?  If  you  are,  say  ‘yes’.  If  you’re 

not,  say  ‘no’  and  I’ll  help  you  to  enroll  in  our  system. 

Details: 

EngScheduling_init  “In  order  to  use  our  automated  scheduling  system, 

you  must  be  an  enrolled  user.  Are  you  an  enrolled  user?  If  you  are,  say 

‘yes’.  If  you’re  not,  say  ‘no’  and  I’ll  help  you  to  enroll  in  our  system.” 

e.  Grammar:  EngScheduling_EngScheduling.gsl#Sample_Rule 


NL  Slots 

V  alues 

<userlnput> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”yes” 

<userlnput  yes> 

”yup” 

<userlnput  yes> 

’’yeah” 

<userlnput  yes> 

”i  think  so” 

<userlnput  yes> 
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”no” 

<userlnput  no> 

’’maybe” 

<userlnput  no> 

”i  don’t  think  so” 

<userlnput  no> 

”i  don’t  know” 

<userlnput  no> 

/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

Thanks. 

EngScheduling#VoiceVer 

serlnput  ==  “yes” 

Details: 

Generic_thanks  “Thanks.” 

ification 

lastresult$ .  interpretation,  u 

Thanks. 

EngScheduling#VoiceEnr 

serlnput  ==  “no” 

Details: 

Generic_thanks  “Thanks.” 

ollment 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

If  you’re  enrolled,  say  ‘yes’.  If  you’re 

not,  say  ‘no’  and  I’ll  help  you  to  enroll 

in  our  system. 

Continue  with  rec  in  this 

state. 

Details: 

EngScheduling_errorl  “If  you’re 

enrolled,  say  ‘yes’.  If  you’re  not,  say 

‘no’  and  I’ll  help  you  to  enroll  in  our 

system.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

If  you’re  already  enrolled  in  our  system, 

say  ‘yes’.  If  you’re  not  or  if  you’re  not 

sure,  say  ‘no’,  and  I’ll  help  you  to  enroll 

in  our  system. 

Continue  with  rec  in  this 

state. 

111 


Details: 

EngScheduling_error2  “If  you’re 
already  enrolled  in  our  system,  say 
‘yes’.  If  you’re  not  or  if  you’re  not  sure, 
say  ‘no’,  and  I’ll  help  you  to  enroll  in 
our  system.” 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  use  our  automated  scheduling 

Continue  with  rec  in  this 

system,  you  must  be  an  enrolled  user.  If 

you  are  already  enrolled  in  our 

automated  scheduling  system,  say  ‘yes’. 

If  you’re  not,  say  ‘no’  and  I’ll  help  you 

to  enroll  in  our  system. 

state. 

Details: 

EngScheduling_help  “In  order  to  use 

our  automated  scheduling  system,  you 

must  be  an  enrolled  user.  If  you  are 

already  enrolled  in  our  automated 

scheduling  system,  say  ‘yes’ .  If  you’re 

not,  say  ‘no’  and  I’ll  help  you  to  enroll 

in  our  system.” 

7.  EngScheduling#ConfirmAccountNbr 

a.  Description 

This  process  asks  callers  to  confirm  their  10-digit  account  number.  (This 
is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 
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Entry  States 

Exit  States 

EngScheduling#V  oiceEnrollment 

EngScheduling#VoiceEnrollment 

EngScheduling#EnrollmentPin 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  [URL  Expression]  Is  that  right? 

Details: 

GenericPromptConfirm_partl  “I  heard” 

URL  Expression:  genPhoneNumber(accountNbr) 

GenericPromptConfirm_part2  “Is  that  right?” 

e.  Grammar: 

EngSchedulingConfirmAccountNbr.gsWBasicYesNo 


NL  Slots 

V  alues 

<confirm> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  c 

I’m  sorry. 

EngScheduling#VoiceEnr 

onfirm  ==  “no” 

Details: 

Generic_imSorry  “I’m  sorry.” 

ollment 

lastresult$ .  interpretations 

Great! 

EngScheduling#Enrollme 

onfirm  ==  “yes” 

Details: 

ntPin 
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Generic_great  “Great!” 


g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

I  got  your  account  number  as  [URL 

Expression]  If  that’s  right,  say  ‘yes’.  If 

it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmAccountNbr_error  “I  got  your 

account  number  as” 

URL  Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

I  got  your  account  number  as  [URL 

Expression]  If  that’s  right,  say  ‘yes’.  If 

it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmAccountNbr_error  “I  got  your 

account  number  as” 

URL  Expression: 

genPhoneNumber(accountNbr) 

Generic  PromptConfirm_y e  sNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  that  I  heard  your 

account  number  correctly.  That  was 

Continue  with  rec  in  this 

state. 
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[URL  Expression]  If  that’ s  right,  say 
‘yes’.  If  it’s  not,  say  ‘no’. 

Details: 

Confirm AccountNbr_help  “I’d  like  to 
make  sure  that  I  heard  your  account 
number  correctly.  That  was” 

URL  Expression: 
genPhoneN  umber(  accountNbr) 
GenericPromptConfirm_yesNo  “If 
that’s  right,  say  ‘yes’.  If  it’s  not,  say 
‘no’.” 


8.  EngScheduling#ConfirmAccountNbr2 

a.  Description 

This  process  asks  callers  to  confirm  their  10-digit  account  number.  (This 
is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#VoiceVerification 

EngScheduling#VoiceVerification 

EngScheduling#NbrCountVerify 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  [URL  Expression]  Is  that  right? 

Details: 

GenericPromptConfirm_partl  “I  heard” 

URL  Expression:  genPhoneNumber(accountNbr) 

GenericPromptConfirm_part2  “Is  that  right?” 
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e.  Grammar: 

EngScheduling_ConJirmAccountNbr2.gsl#Basic_Yes_No 


NL  Slots 

V  alues 

<confirm> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  c 

I’m  sorry. 

EngScheduling#VoiceVer 

onfirm  ==  “no” 

Details: 

Generic_imSorry  “I’m  sorry.” 

ification 

lastresultS .  interpretation,  c 

Great! 

EngScheduling#NbrCount 

onfirm  ==  “yes” 

Details: 

Generic_great  “Great!” 

Verify 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

I  got  your  account  number  as  [URL 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  If  that’s  right,  say  ‘yes’.  If 

state. 

maxspeechtimeout 

it’s  not,  say  ‘no’. 

Details: 

ConfirmAccountNbr_error  “I  got  your 

account  number  as” 

URL  Expression: 

genPhoneN  umber(  ac  countNbr) 
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GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

WHEN ( COUNT  =  2 ) 

I  got  your  account  number  as  [URL 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  If  that’s  right,  say  ‘yes’.  If 

state. 

maxspeechtimeout 

it’s  not,  say  ‘no’. 

Details: 

ConfirmAccountNbr_error  “I  got  your 

account  number  as” 

URL  Expression: 

genPhoneN  umber(  ac  countNbr) 

GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  that  I  heard  your 

Continue  with  rec  in  this 

account  number  correctly.  That  was 

[URL  Expression]  If  that’s  right,  say 

‘yes’.  If  it’s  not,  say  ‘no’. 

state. 

Details: 

Confirm AccountNbr_help  “I’d  like  to 

make  sure  that  I  heard  your  account 

number  correctly.  That  was” 

URL  Expression: 

genPhoneN umber(  ac  countNbr) 

Generic  PromptConfirm_y e  sNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 
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9.  EngScheduling#ConfirmEnrollPin 

a.  Description 

This  process  asks  callers  to  confirm  their  4-digit  enrollment  PIN.  (This  is 
a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#EnroltmentPin 

EngScheduling#EnrollmentPin 

EngScheduling#EnrollCheck 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  [URL  Expression]  Is  that  right? 

Details: 

GenericPromptConfirm_partl  “I  heard” 

URL  Expression:  genEnrollNumber(enrollmentPin) 

GenericPromptConfirm_part2  “Is  that  right?” 

e.  Grammar: 

EngScheduling_ConfirmEnrollPin.gsWBasic_Yes_No 


NL  Slots 

V  alues 

<confirm> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f  Actions 
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Condition 

Action 

Goto 

lastresult$ .  interpretation,  c 

I’m  sorry. 

EngScheduling#Enrollme 

onfirm  ==  “no” 

Details: 

Generic_imSorry  “I’m  sorry.” 

ntPin 

lastresult$ .  interpretations 

Great! 

EngScheduling#EnrollChe 

onfirm  ==  “yes” 

Details: 

Generic_great  “Great!” 

ck 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

I  got  your  secret  date  as  [URL 

Expression]  If  that’s  right,  say  ‘yes’.  If 

it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmEnrollmentPin_error  “I  got 

your  secret  date  as” 

URL  Expression: 

genEnrollNumber(enrollmentPin) 

Generic  PromptConfirm_y e  sNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

I  got  your  secret  date  as  [URL 

Expression]  If  that’s  right,  say  ‘yes’.  If 

it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmEnrollmentPin_error  “I  got 

your  secret  date  as” 

URL  Expression: 

genEnrollNumber(enrollmentPin) 

Generic  PromptConfirm_y e  sNo  “If 
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that’s  right,  say  ‘yes’.  If  it’s  not,  say 
‘no’.” 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  that  I  heard  your 

enrollment  code  correctly.  That  code 

was  [URL  Expression]  If  that’s  right, 

say  ‘yes’.  If  it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmEnrollmentPin_help  “I’d  like  to 

make  sure  that  I  heard  your  enrollment 

code  correctly.  That  code  was” 

URL  Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

10.  EngScheduling#ConfirmSecretDate 

a.  Description 

This  process  asks  callers  to  confirm  their  secret  date.  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#GetSecretDate 

EngScheduling#GetSecretDate 

EngScheduling#RecordReminder 
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d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  [lOOmsecs]  [date:m]  [50msecs]  [date:d]  [50msecs]  [date:y] 

[lOOmsecs]  Is  that  right? 

Details: 

GenericPromptConfirm_partl  “I  heard” 

Silence:  100  msecs 

TTS  Expression  [date:m]:  DATE_OUT_month 

Silence:  50  msecs 

TTS  Expression  [date:d]:  DATE_OUT_day 

Silence:  50  msecs 

TTS  Expression  [date:y]:  DATE_OUT_year 

Silence:  100  msecs 

GenericPromptConfirm_part2  “Is  that  right?” 

e.  Grammar: 

EngScheduling_ConfirmSecretDate.gsl#Basic_Yes_No 


NL  Slots 

V  alues 

<confirm> 

no,  yes 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretation,  c 

onfirm  ==  “no” 

I’m  sorry. 

Details: 

Generic_imSorry  “I’m  sorry.” 

EngScheduling#GetSecret 

Date 

lastresultS  ■  interpretation,  c 

Sure. 

EngScheduling#RecordRe 
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onfirm  ==  “yes” 

Details: 

minder 

Generic_sure  “Sure.” 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Td  like  to  make  sure  I  got  your  secret 

date  correctly.  I  heard  the  date  as 

[lOOmsecs]  [date:m]  [50msecs]  [date:d] 

[50msecs]  [date:y]  [lOOmsecs]  If  that’s 

right,  say  ‘yes’.  If  it’s  not,  say  ‘no’. 

Details: 

ConfirmSecretDate_error  “I’d  like  to 

make  sure  I  got  your  secret  date 

correctly.  I  heard  the  date  as” 

Silence:  100  msecs 

TTS  Expression  [date:m]: 

DATE_OUT_month 

Silence:  50  msecs 

TTS  Expression  [date:d]: 

DATE_OUT_day 

Silence:  50  msecs 

TTS  Expression  [date:y]: 

DATE_OUT_year 

Silence:  100  msecs 

Generic  PromptConfirm_y e  sNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

Continue  with  rec  in  this 

state. 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

I’d  like  to  make  sure  I  got  your  secret 

date  correctly.  I  heard  the  date  as 

[lOOmsecs]  [date:m]  [50msecs]  [date:d] 

[50msecs]  [date:y]  [lOOmsecs]  If  that’s 

right,  say  ‘yes’.  If  it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 
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Details: 

ConfirmSecretDate_error  “I’d  like  to 
make  sure  I  got  your  secret  date 
correctly.  I  heard  the  date  as” 

Silence:  100  msecs 

TTS  Expression  [date:m]: 

DATE_OUT_month 

Silence:  50  msecs 

TTS  Expression  [date:d]: 

DATE_OUT_day 

Silence:  50  msecs 

TTS  Expression  [date:y]: 

DATE_OUT_year 

Silence:  100  msecs 

GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  I  got  your  secret 

Continue  with  rec  in  this 

date  correctly.  If  your  secret  date  is 

[lOOmsecs]  [date:m]  [50msecs]  [date:d] 

[50msecs]  [date:y]  [lOOmsecs]  If  that’s 

right,  say  ‘yes’.  If  it’s  not,  say  ‘no’. 

state. 

Details: 

ConfirmSecretDate_help  “I’d  like  to 

make  sure  I  got  your  secret  date 

correctly.  If  your  secret  date  is” 

Silence:  100  msecs 

TTS  Expression  [date:m]: 

DATE  OUT  month 
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Silence:  50  msecs 

TTS  Expression  [date:d]: 

DATE_OUT_day 

Silence:  50  msecs 

TTS  Expression  [date:y]: 

DATE_OUT_year 

Silence:  100  msecs 

Generic  PromptConfirm_y e  sNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 


11.  EngScheduling#EnrollCheck 

a.  Description 

This  process  asks  callers  if  they  would  like  to  “enroll  me  now.”  For 
demostration  purposes,  links  to  additional  verification  information  is  not  included  in  this 
application.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#ConfirmEnrollPin 

EngScheduling#NbrCountOne 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Now  it  looks  like  we  haven’t  yet  enrolled  you  in  our  Voiceprint 

Verification  System.  This'll  let  us  identify  you  using  your  unique 

voiceprint,  which  is  faster  and  more  convenient  that  a  PIN  or  password. 

We  only  need  to  enroll  you  once,  and  it’ll  just  take  a  minute.  To  go 

ahead  with  the  enrollment  process  right  now,  say  ‘enroll  me  now’ . 

Details: 

EnrollCheck_init  “Now  it  looks  like  we  haven’t  yet  enrolled  you  in  our 
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Voiceprint  Verification  System.  This’ll  let  us  identify  you  using  your 
unique  voiceprint,  which  is  faster  and  more  convenient  that  a  PIN  or 
password.  We  only  need  to  enroll  you  once,  and  it’ll  just  take  a  minute. 
To  go  ahead  with  the  enrollment  process  right  now,  say  ‘enroll  me 
now’ .” 


e.  Grammar:  EngScheduling_EnrollCheck.gsl#Sample_Rule 


NL  Slots 

V  alues 

<userlnput> 

enrollMeNow 

Sample  Phrases 

Slots  Filled 

’’enroll” 

<userlnput  enrollMeNow> 

’’enroll  me” 

<userlnput  enrollMeNow> 

’’enroll  me  now” 

<userlnput  enrollMeNow> 

”uh  enroll  me  now” 

<userlnput  enrollMeNow> 

”i  want  to  enroll  now” 

<userlnput  enrollMeNow> 

’’sure  enroll  me  now” 

<userlnput  enrollMeNow> 

’’please  enroll  me  now” 

<userlnput  enrollMeNow> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  u 

serlnput  == 

“enrollMeNow” 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

— 

EngScheduling#NbrCount 

One 
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g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

To  get  started  on  the  enrollment  process. 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

say  ‘enroll  me  now’ . 

Details: 

EnrollCheck_error  “To  get  started  on 

the  enrollment  process,  say  ‘enroll  me 

now’.” 

state. 

WHEN ( COUNT  =  2 ) 

To  get  started  on  the  enrollment  process. 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

say  ‘enroll  me  now’ . 

Details: 

EnrollCheck_error  “To  get  started  on 

the  enrollment  process,  say  ‘enroll  me 

now’.” 

state. 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

To  go  ahead  with  the  enrollment  process 

Continue  with  rec  in  this 

right  now,  say  ‘enroll  me  now’ . 

state. 

Details: 

EnrollCheck_help  “To  go  ahead  with 

the  enrollment  process  right  now,  say 

‘enroll  me  now’.” 

12.  EngScheduling#EnrollmentPin 

a.  Description 

This  process  asks  caller  for  their  4-digit  enrollment  PIN.  (This  is  a 
recognition  state.) 

b.  Special  Features 
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c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#ConfirmAccountNbr 

EngScheduling#ConfirmEnrollPin 

EngScheduling#ConfirmEnrollPin 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Next,  I  need  to  get  the  4-digit  enrollment  code  from  the  enrollment 

notice  that  we  sent  you.  So  take  a  moment  to  find  that  code  now,  and 

when  you’re  ready,  go  ahead  and  say  it,  or  just  key  it  in. 

Details: 

EnrollmentPin_init  “Next,  I  need  to  get  the  4-digit  enrollment  code 

from  the  enrollment  notice  that  we  sent  you.  So  take  a  moment  to  find 

that  code  now,  and  when  you’re  ready,  go  ahead  and  say  it,  or  just  key  it 

in.” 

Entry  Type  =  reentry 

Please  say  or  key  in  your  4-digit  enrollment  code  again. 

Details: 

EnrollmentPin_reentry  “Please  say  or  key  in  your  4-digit  enrollment 

code  again.” 

e.  Grammar:  builtin:digits?length=4;minlength=4;maxlength=4 


NL  Slots 

V  alues 

<enrollmentPin> 

pinNbr 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four” 

<built-in  true> 

f  Actions 


Condition 


Action 


Goto 
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lastresult  ==  true 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

Assign:  enrollmentPin  =  lastresult 

EngScheduling#ConfirmE 

nrollPin 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  say  or  key  in  your  4-digit 

Continue  with  rec  in  this 

nomatch  noinput 

enrollment  code. 

state. 

maxspeechtimeout 

Details: 

EnrollmentPin_error  “Please  say  or  key 

in  your  4-digit  enrollment  code.” 

WHEN ( COUNT  =  2 ) 

Please  say  or  key  in  your  4-digit 

Continue  with  rec  in  this 

nomatch  noinput 

enrollment  code. 

state. 

maxspeechtimeout 

Details: 

EnrollmentPin_error  “Please  say  or  key 

in  your  4-digit  enrollment  code.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

Please  say  or  key  in  your  4-digit 

Continue  with  rec  in  this 

enrollment  code  from  the  enrollment 

state. 

notice  that  we  sent  you. 

Details: 

EnrollmentPin_help  “Please  say  or  key 

in  your  4-digit  enrollment  code  from  the 

enrollment  notice  that  we  sent  you.” 
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13.  EngScheduling#GetSecretDate 


a.  Description 

This  process  asks  callers  for  a  secret  date,  callers  can  specify  the  day, 
month  and  the  year.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#NbrCountThree 

EngScheduling#ConfirmSecretDate 

EngScheduling#ConfirmSecretDate 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Next  I’ll  get  the  secret  information  that  we’ll  ask  you  for  occasionally. 

This’ll  be  a  date  that’s  easy  for  you  to  remember,  but  hard  for  others  to 

guess,  like  a  special  anniversary  or  a  friend’s  birthday.  So,  think  of  the 

secret  date  you’d  like  to  use,  and  when  you’re  ready,  just  tell  me  that 

date,  including  the  year,  like  this  April  1st  1998. 

Details: 

GetSecretDate_init  “Next  I’ll  get  the  secret  information  that  we’ll  ask 

you  for  occasionally.  This’ll  be  a  date  that’s  easy  for  you  to  remember, 

but  hard  for  others  to  guess,  like  a  special  anniversary  or  a  friend’ s 

birthday.  So,  think  of  the  secret  date  you’d  like  to  use,  and  when  you’re 

ready,  just  tell  me  that  date,  including  the  year,  like  this  April  1st  1998.” 

Entry  Type  =  reentry 

Please  reenter  your  secret  date,  like  this,  April  1st  1998. 

Details: 

GetSecretDate_reentry  “Please  reenter  your  secret  date,  like  this,  April 

1st  1998.” 
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e.  Grammar: 

EngScheduling_GetSecretDate.gsl#DATE_VOICE_OR_DTMF 


NL  Slots 

V  alues 

<day> 

day 

<month> 

month 

<year> 

year 

Sample  Phrases 

Slots  Filled 

’’may  thirteenth  nineteen  ninety-nine” 

<day  day> 

<month  month> 

<year  year> 

’’the  thirteenth  of  may  nineteen  ninety  nine” 

<day  day> 

<month  month> 

<year  year> 

’’five  thirteen  nineteen  ninety  nine” 

<day  day> 

<month  month> 

<year  year> 

f.  Actions 


Condition 

Action 

Goto 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

Assign:  DATE_OUT_day  = 

lastresult$. interpretation. date. day 

Assign:  DATE_OUT_month  = 

lastresult$. interpretation. date. month 

Assign:  DATE_OUT_year  = 
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lastresult$. interpretation. date. year 

Log:  ’ D ATE_OUT_day  is  ‘  +  DATE_OUT_day 

Log:  ’DATE_OUT_month  is  ‘  + 

DATE_OUT_month 

Log:  ’DATE_OUT_year  is  1  +DATE_OUT_year 

— 

EngScheduling#ConfirmS 

ecretDate 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Please  say  or  key  in  your  secret  date, 

like  this,  April  1st  1998. 

Details: 

GetSecretDate_errorl  “Please  say  or 

key  in  your  secret  date,  like  this,  April 

1st  1998.” 

Continue  with  rec  in  this 

state. 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Please  enter  a  date  that’ s  easy  for  you  to 

remember,  but  hard  for  others  to  guess, 

like  a  special  anniversary  or  a  friend’s 

birthday.  So,  think  of  the  secret  date 

you’d  like  to  use,  and  when  you’re 

ready,  just  tell  me  that  date,  including 

the  year,  like  this  April  1st  1998. 

Continue  with  rec  in  this 

state. 

Details: 

GetSecretDate_error2  “Please  enter  a 

date  that’ s  easy  for  you  to  remember, 

but  hard  for  others  to  guess,  like  a 

special  anniversary  or  a  friend’s 

birthday.  So,  think  of  the  secret  date 
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you’d  like  to  use,  and  when  you’re 
ready,  just  tell  me  that  date,  including 
the  year,  like  this  April  1st  1998.” 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

Please  enter  a  secret  date  that’s  easy  for 

you  to  remember,  but  hard  for  others  to 

guess.  When  you’re  ready,  just  tell  me 

that  date,  including  the  year,  like  this 

April  1st  1998. 

Continue  with  rec  in  this 

state. 

Details: 

GetSecretDate_help  “Please  enter  a 

secret  date  that’s  easy  for  you  to 

remember,  but  hard  for  others  to  guess. 

When  you’re  ready,  just  tell  me  that 

date,  including  the  year,  like  this  April 

1st  1998.” 

14.  EngScheduling#NbrCountOne 

a.  Description 

Number  count  one  for  voice  model  collection.  This  process  asks  callers  to 
count  from  1  to  9.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#EnrollCheck 

EngScheduling#NbrCountTwo 

d.  Pre-rec  Prompts 
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Type  and  Condition 

Action 

Entry  Type  =  initial 

Now,  to  create  your  voiceprint,  first  I’ll  ask  you  to  count  from  1  to  9, 

three  separate  times,  so  that  the  system  can  analyze  your  voice.  Then  I’ll 

ask  you  for  some  secret  information  that  we  might  need  to  get  from  you 

occasionally,  just  for  extra  security.  So  to  get  started,  please  count  out 

loud,  once  from  1  to  9  like  this,  one,  two,  three,  and  so  on. 

Details: 

NbrCountOne_init  “Now,  to  create  your  voiceprint,  first  I’ll  ask  you  to 

count  from  1  to  9,  three  separate  times,  so  that  the  system  can  analyze 

your  voice.  Then  I’ll  ask  you  for  some  secret  information  that  we  might 

need  to  get  from  you  occasionally,  just  for  extra  security.  So  to  get 

started,  please  count  out  loud,  once  from  1  to  9  like  this,  one,  two,  three, 

and  so  on.” 

e.  Grammar:  EngScheduling_NbrCountOne.gsl#Sample_Rule 


NL  Slots 

V  alues 

<uselnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four  five  six  seven  eight  nine” 

<uselnput  nbrCount> 

f  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretations 

selnput  ==  “nbrCount” 

EngScheduling#NbrCount 

Two 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Please  count  out  loud,  once,  from  1  to  9 

like  this  one,  two,  three,  and  so  on. 

Continue  with  rec  in  this 

state. 
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Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

WHEN ( COUNT  =  2 ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

state. 

h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  create  your  voiceprint,  please 

count  out  loud,  once  from  1  to  9  like 

this,  one,  two,  three,  and  so  on. 

Continue  with  rec  in  this 

state. 

Details: 

NbrCount_help  “In  order  to  create  your 

voiceprint,  please  count  out  loud,  once 

from  1  to  9  like  this,  one,  two,  three,  and 

so  on.” 

15.  EngScheduling#NbrCountThree 

a.  Description 

Number  count  three  for  voice  model  collection.  (This  is  a  recognition 

state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 


Exit  States 
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EngScheduling#NbrCountTwo 


EngScheduling#GetSecretDate 


d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

And  one  last  time. 

Details: 

NbrCountThree_init  “And  one  last  time.” 

e.  Grammar:  EngScheduling_NbrCountThree.gsl#Sample_Rule 


NL  Slots 

V  alues 

<userlnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four  five  six  seven  eight  nine” 

<userlnput  nbrCount> 

f  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretations 

serlnput  ==  "nbrCount” 

Great! 

Details: 

Generic_great  “Great!” 

EngScheduling#GetSecret 

Date 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

like  this  one,  two,  three,  and  so  on. 

state. 

maxspeechtimeout 

Details: 

NbrCount_error  “Please  count  out  loud. 

once,  from  1  to  9  like  this  one,  two. 
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three,  and  so  on.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Please  count  out  loud,  once,  from  1  to  9 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

Continue  with  rec  in  this 

state. 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  create  your  voiceprint,  please 

Continue  with  rec  in  this 

count  out  loud,  once  from  1  to  9  like 

state. 

this,  one,  two,  three,  and  so  on. 

Details: 

NbrCount_help  “In  order  to  create  your 

voiceprint,  please  count  out  loud,  once 

from  1  to  9  like  this,  one,  two,  three,  and 

so  on.” 

1 6.  EngScheduling#Nbr  CountT  wo 

a.  Description 

Number  count  two  for  voice  model  collection.  (This  is  a  recognition 

state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#NbrCountOne 

EngScheduling#NbrCountThree 

d. 


Pre-rec  Prompts 
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Type  and  Condition 

Action 

Entry  Type  =  initial 

And,  once  more,  please? 

Details: 

NbrCountTwo_init  “And,  once  more,  please?” 

e.  Grammar:  EngScheduling_NbrCountTwo.gsl#Sample_Rule 


NL  Slots 

V  alues 

<userlnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four  five  six  seven  eight  nine” 

<userlnput  nbrCount> 

f.  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretations 

serlnput  ==  “nbrCount” 

EngScheduling#NbrCount 

Three 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

state. 

WHEN ( COUNT  =  2 ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud. 

state. 
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once,  from  1  to  9  like  this  one,  two, 
three,  and  so  on.” 


h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  create  your  voiceprint,  please 

Continue  with  rec  in  this 

count  out  loud,  once  from  1  to  9  like 

state. 

this,  one,  two,  three,  and  so  on. 

Details: 

NbrCount_help  “In  order  to  create  your 

voiceprint,  please  count  out  loud,  once 

from  1  to  9  like  this,  one,  two,  three,  and 

so  on.” 

17.  EngScheduling#NbrCountVerify 

a.  Description 

Number  count  for  voice  verification.  This  process  asks  callers  to  count 
from  1  to  9.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#ConfirmAccountNbr2 

EngDetaineeAppt#EngDetaineeAppt 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Now  to  verify  your  voice,  please  count  out  loud  from  one  up  to  nine. 

Details: 

NbrCount Verify _init  “Now  to  verify  your  voice,  please  count  out  loud 
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from  one  up  to  nine.” 


e.  Grammar:  EngScheduling_NbrCountVerifiy.gsWSample_Rule 


NL  Slots 

V  alues 

<uselnput> 

nbrCount 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four  five  six  seven  eight  nine” 

<uselnput  nbrCount> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretations 

selnput  ==  “nbrCount” 

You’re  been  verified. 

Details: 

NbrCount Verify_post  “You’re  been  verified.” 

EngDetaineeAppt#EngDet 

aineeAppt 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

state. 

WHEN ( COUNT  =  2 ) 

Please  count  out  loud,  once,  from  1  to  9 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

like  this  one,  two,  three,  and  so  on. 

Details: 

NbrCount_error  “Please  count  out  loud, 

once,  from  1  to  9  like  this  one,  two, 

three,  and  so  on.” 

state. 
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h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  verify  your  account,  please 

Continue  with  rec  in  this 

count  out  loud  once  from  1  to  9  like  this, 

state. 

one,  two,  three  and  so  on. 

Details: 

NbrCount Verify _help  “In  order  to 

verify  your  account,  please  count  out 

loud  once  from  1  to  9  like  this,  one,  two, 

three  and  so  on.” 

18.  EngScheduling#RecordReminder 

a.  Description 

This  process  simulates  the  NCA  process  of  recording  a  callers’  hint  to 
their  secret  date.  For  demostration  purposes,  this  recording  is  not  saved  to  any  backend 
database.  (This  is  a  record  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#ConfirmSecretDate 

- 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Now  think  of  a  hint  that’ll  remind  you  of  that  date.  After  you  hear  the 

beep,  tell  me  that  hint  and  we’ll  record  it  so  that  we  can  play  it  back  to 

you  later.  So,  for  example,  you  might  say  my  mother’s  birthday  or  my 

graduation  date. 
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Details: 

RemindDate_init  “Now  think  of  a  hint  that’ll  remind  you  of  that  date. 
After  you  hear  the  beep,  tell  me  that  hint  and  we’ll  record  it  so  that  we 
can  play  it  back  to  you  later.  So,  for  example,  you  might  say  my 
mother’s  birthday  or  my  graduation  date.” 


e.  Actions 


Condition 

Action 

Goto 

OK!  we’ve  successfully  enrolled  your  voiceprint. 

Details: 

RemindDate_post  “OK!  we’ve  successfully 

enrolled  your  voiceprint.” 

Return  to  the  calling 

dialog 

f  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  tell  me  a  hint  that  will  remind 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

you  of  your  secret  date. 

Details: 

RemindDate_error  “Please  tell  me  a 

hint  that  will  remind  you  of  your  secret 

date.” 

state. 

WHEN ( COUNT  =  2 ) 

Please  tell  me  a  hint  that  will  remind 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

you  of  your  secret  date. 

Details: 

RemindDate_error  “Please  tell  me  a 

hint  that  will  remind  you  of  your  secret 

date.” 

state. 
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19.  EngScheduling#VoiceEnrollment 

a.  Description 

Simulates  the  NCA  voice  enrollment  process.  This  process  asks  callers 
for  their  10-digit  account  number.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#EngScheduling 

EngScheduling#ConfirmAccountNbr 

EngScheduling#ConfirmAccountNbr 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

To  get  started  on  the  voice  enrollment  process,  I  need  your  10-digit 

account  number.  If  you  don’t  have  an  account  number,  or  if  you’ve  lost 

it,  please  go  to  your  nearest  police  station  to  register  for  a  new  account. 

If  you  have  the  account  number,  go  ahead  and  say  or  key  it  in  now. 

Details: 

VoiceEnrollment_init  “To  get  started  on  the  voice  enrollment  process,  I 

need  your  10-digit  account  number.  If  you  don’t  have  an  account 

number,  or  if  you’ve  lost  it,  please  go  to  your  nearest  police  station  to 

register  for  a  new  account.  If  you  have  the  account  number,  go  ahead 

and  say  or  key  it  in  now.” 

Entry  Type  =  reentry 

Please  say  or  key-in  your  10-digit  account  number  one  more  time. 

Details: 

VoiceEnrollment_reentry  “Please  say  or  key-in  your  10-digit  account 

number  one  more  time.” 
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e.  Grammar: 

builtin:digits?length-10;minlength-10;maxlength-10 


NL  Slots 

V  alues 

<userlnput> 

accountNbr 

Sample  Phrases 

Slots  Filled 

’’zero  one  two  three  four  five  six  seven  eight  nine” 

<built-in  “yes”> 

f  Actions 


Condition 

Action 

Goto 

lastresult  ==  true 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

— 

Assign:  accountNbr  =  lastresult 

EngScheduling#ConfirmA 

ccountNbr 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  say  or  key-in  your  10-digit 

Continue  with  rec  in  this 

nomatch  noinput 

account  number. 

state. 

maxspeechtimeout 

Details: 

VoiceEnrollment_errorl  “Please  say  or 

key-in  your  10-digit  account  number.” 

WHEN ( COUNT  =  2 ) 

To  get  you  started  on  the  voice 

Continue  with  rec  in  this 

nomatch  noinput 

enrollment  process,  I  need  to  have  your 

state. 

maxspeechtimeout 

10-digit  account  number.  Please  key  it 

in,  or  say  ‘help’  for  more  information. 

Details: 
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VoiceEnrollment_error2  “To  get  you 
started  on  the  voice  enrollment  process, 
1  need  to  have  your  10-digit  account 
number.  Please  key  it  in,  or  say  ‘help’ 
for  more  information.” 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  enroll  in  our  automated 

Continue  with  rec  in  this 

scheduling  system,  you  must  have  a  10- 

digit  account  number.  If  you  don’t  have 

your  account  number  or  if  you’ve  lost  it, 

please  hang  up  and  go  to  your  local 

police  station  to  register  for  a  new 

account.  If  you  have  your  account 

number,  please  say  or  key-in  the  number 

state. 

now. 

Details: 

VoiceEnrollment_help  “In  order  to 

enroll  in  our  automated  scheduling 

system,  you  must  have  a  10-digit 

account  number.  If  you  don’ t  have  your 

account  number  or  if  you’ve  lost  it, 

please  hang  up  and  go  to  your  local 

police  station  to  register  for  a  new 

account.  If  you  have  your  account 

number,  please  say  or  key-in  the  number 

now.” 

20.  EngScheduling#VoiceVerification 
a.  Description 
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Simulates  the  NCA  verification  process.  This  process  asks  callers  for  their 
10-digit  account  number.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngScheduling#EngSchedtiling 

EngScheduling#ConfirmAccountNbr2 

EngScheduling#ConfirmAccountNbr2 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

To  get  started,  go  ahead  and  say  or  key-in  your  10-digit  account  number. 

Details: 

VoiceVerification_init  “To  get  started,  go  ahead  and  say  or  key-in  your 

10-digit  account  number.” 

Entry  Type  =  reentry 

Please  say  or  key-in  your  10-digit  account  number  one  more  time. 

Details: 

VoiceVerification_reentry  “Please  say  or  key-in  your  10-digit  account 

number  one  more  time.” 

e.  Grammar: 

builtin:digits?length=10;minlength=10;maxlength=10 


NL  Slots 

V  alues 

<userlnput> 

accountNbr 

Sample  Phrases 

Slots  Filled 

’’zero  one  two  three  four  five  six  seven  eight  nine” 

<built-in  true> 

f  Actions 
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Condition 

Action 

Goto 

lastresult  ==  true 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

— 

Assign:  accountNbr  =  lastresult 

EngScheduling#ConfirmA 

ccountNbr2 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  say  or  key-in  your  10-digit 

Continue  with  rec  in  this 

nomatch  noinput 

account  number. 

state. 

maxspeechtimeout 

Details: 

VoiceVerification_errorl  “Please  say  or 

key-in  your  10-digit  account  number.” 

WHEN ( COUNT  =  2 ) 

Please  key-in  your  10-digit  account 

Continue  with  rec  in  this 

nomatch  noinput 

maxspeechtimeout 

number  or  say  ‘help’  for  more 

information. 

state. 

Details: 

VoiceVerification_error2  “Please  key- 

in  your  10-digit  account  number  or  say 

‘help’  for  more  information.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

To  get  started  on  the  voice  verification 

process,  please  say  or  key- in  your  10- 

digit  account  number.  If  you  don’t  have 

a  10-digit  account  number  or  if  you’ve 

lost  it,  please  go  to  your  local  police 

Continue  with  rec  in  this 

state. 
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station  to  register  for  a  new  account.  If 
you  have  the  number,  please  go  ahead 
and  say  or  key  it  in  now. 

Details: 

VoiceVerification_help  “To  get  started 
on  the  voice  verification  process,  please 
say  or  key-in  your  10-digit  account 
number.  If  you  don’t  have  a  10-digit 
account  number  or  if  you’ve  lost  it, 
please  go  to  your  local  police  station  to 
register  for  a  new  account.  If  you  have 
the  number,  please  go  ahead  and  say  or 
key  it  in  now.” 


21.  EngDetaineeAppt  Page  Information 

a.  Description 

This  page  demostrates  the  call  flow  for  a  detainee  appointment  scheduling 
application,  no  interaction  with  backend  database. 

b.  Page  Variables 


Page  Variables  Table 

Name 

Initial  Value 

Description 

DetaineelSN 
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c. 


Call  Flow 


22.  EngDetaineeAppt#EngDetaineeAppt 

a.  Description 

Ask  callers  if  they  would  like  to  schedule  a  new  appointment  to  visit  a 
detainee  or  check  to  see  if  a  pending  appointment  is  scheduled.  (This  is  a  recognition 
state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 
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Entry  States 

Exit  States 

EngScheduling#NbrCountVerify 

EngDetaineeAppt#CheckAppointment 

EngDetaineeAppt#New  Appointment 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Next,  please  select  from  the  following  options.  If  you’d  like  to  make  a 

new  appointment,  say  ‘new  appointment’.  If  you’d  like  to  check  the 

status  of  a  pending  appointment,  say  ‘check  appointment’ . 

Details: 

EngDetaineeAppt_init  “Next,  please  select  from  the  following  options. 

If  you’d  like  to  make  a  new  appointment,  say  ‘new  appointment’.  If 

you’d  like  to  check  the  status  of  a  pending  appointment,  say  ‘check 

appointment’ .” 

e.  Grammar: 

EngDetaineeAppt_EngDetaineeAppt.gsl#Sample_Rule 


NL  Slots 

Values 

<userlnput> 

newAppoinment,  checkAppointment 

Sample  Phrases 

Slots  Filled 

’’check  appointment” 

<userlnput  checkAppointment> 

”uh  check  appointment" 

<userlnput  checkAppointment> 

”i’d  like  to  check  appointment” 

<userlnput  checkAppointment> 

’’check  existing  appointment” 

’’new  appointment” 

<userlnput  newAppoinment> 

”uh  new  appointment” 

<userlnput  newAppoinment> 

’’make  new  appointment” 

<userlnput  newAppoinment> 

”i’d  like  to  make  a  new  appointment” 

<userlnput  newAppoinment> 
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/.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation. u 

Sure. 

EngDetaineeAppt#Check 

serlnput  == 

Appointment 

“checkAppointment” 

Details: 

Generic_sure  “Sure.” 

lastresult$ .  interpretation,  u 

Sure. 

EngDetaineeAppt#NewA 

serlnput  == 

ppointment 

“newAppoinment” 

Details: 

Generic_sure  “Sure.” 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Which  did  you  want  to  do:  set  up  a  new 

appointment  or  check  a  pending 

appointment? 

Continue  with  rec  in  this 

state. 

Details: 

EngDetaineeAppt_errorl  “Which  did 

you  want  to  do:  set  up  a  new 

appointment  or  check  a  pending 

appointment?” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

To  set  up  a  new  appointment  now,  say 

‘new  appointment’.  To  check  a  pending 

appointment,  say  ‘check  appointment’ . 

Continue  with  rec  in  this 

state. 

Details: 

EngDetaineeAppt_error2  “To  set  up  a 

new  appointment  now,  say  ‘new 

appointment’.  To  check  a  pending 

appointment,  say  ‘check  appointment’ .” 
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h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

If  you’d  like  to  make  a  new  appointment 

Continue  with  rec  in  this 

to  meet  with  a  detainee,  say  ‘new 

appointment’.  If  you’d  like  to  check  a 

pending  appointment  to  see  if  it  has 

been  scheduled,  say  ‘check 

appointment’ . 

state. 

Details: 

EngDetaineeAppt_help  “If  you’d  like  to 

make  a  new  appointment  to  meet  with  a 

detainee,  say  ‘new  appointment’.  If 

you’d  like  to  check  a  pending 

appointment  to  see  if  it  has  been 

scheduled,  say  ‘check  appointment’ .” 

23.  EngDetaineeAppt#CheckAppointment 

a.  Description 

(This  is  a  non-recognition  processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#EngDetaineeAppt 

- 

d.  Actions 


Condition 

Action 

Goto 

— 

Based  on  our  records,  you  have  no  scheduled 

appointments  at  this  time.  If  you’ve  called  earlier 

Return  to  the  calling 

dialog 
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to  set  up  an  appointment,  note  that  it  takes  24  hours 
for  the  appointment  to  get  scheduled.  Please  check 
back  at  a  later  time. 

Details: 

CheckAppointment_init  “Based  on  our  records, 
you  have  no  scheduled  appointments  at  this  time.  If 
you’ve  called  earlier  to  set  up  an  appointment,  note 
that  it  takes  24  hours  for  the  appointment  to  get 
scheduled.  Please  check  back  at  a  later  time.” 


24.  EngDetaineeAppt#CheckDetaineeISN 

a.  Description 

This  process  simulates  interaction  with  a  back-end  database.  It  is 
envisioned  that  the  inputs  to  the  database  are  the  caller’s  account  number  and  detainee’s 
ISN.  The  database  will  then  match  the  two  numbers,  if  the  database  confirms  that  the 
caller  is  a  registered  visitor  of  the  detainee,  the  database  will  generate  a  voice  recording 
of  the  detainee’s  name.  If  the  two  numbers  do  not  match,  the  system  will  return  a  prompt 
stating  that  the  caller  is  not  a  registered  visitor  of  the  detainee.  (This  is  a  non-recognition 
processing  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#ConfirmDetaineeISN 

EngDetaineeAppt#GetVisitationDate 

d.  Actions 


Condition 

Action 

Goto 

Next,  please  wait  while  I  check  to  see  if  you’re  a 

registered  visitor  of  the  detainee  with  ISN  [URL 

Expression]  [lOOOmsecs]  Thanks.  I’ve  confirmed 

EngDetainee  Appt#Get  V  is 

itationDate 
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that  you’re  a  registered  visitor  of  Abu  Musab  Al- 
Zarqawi 

Details: 

CheckDetaineeISN_initPartl  “Next,  please  wait 
while  I  check  to  see  if  you’re  a  registered  visitor  of 
the  detainee  with  ISN” 

URL  Expression:  genlSNumber(DetaineelSN) 
Silence:  1000  msecs 

CheckDetaineeISN_initPart2  “Thanks.  I’ve 
confirmed  that  you’re  a  registered  visitor  of’ 
DetaineeName  “Abu  Musab  Al-Zarqawi” 


25.  EngDetaineeAppt#ConfirmDetaineeISN 

a.  Description 

This  process  asks  callers  to  confirm  the  detainee’s  9-digit  ISN.  (This  is  a 
recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#EnterDetaineeISN 

EngDetaineeAppt#EnterDetaineeISN 

EngDetaineeAppt#CheckDetaineeISN 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  [URL  Expression]  Is  that  right? 

Details: 

GenericPromptConfirm_partl  “I  heard” 

URL  Expression:  genlSNumber(DetaineelSN) 

GenericPromptConfirm_part2  “Is  that  right?” 
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e.  Grammar: 

EngDetaineeAppt_ConfirmDetaineeISN.gsl#Basic_Yes_No 


NL  Slots 

V  alues 

<confirm> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f  Actions 


Condition 

Action 

Goto 

lastresultS .  interpretation,  c 

I’m  sorry. 

EngDetaineeAppt#EnterD 

onfirm  ==  “no” 

Details: 

Generic_imSorry  “I’m  sorry.” 

etaineelSN 

lastresultS  ■  interpretation,  c 

EngDetaineeAppt#Check 

onfirm  ==  “yes” 

DetaineelSN 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

I  heard  the  detainee’s  ISN  as  [URL 

Expression]  If  that’s  right,  say  ‘yes’.  If 

it’s  not,  say  ‘no’. 

Continue  with  rec  in  this 

state. 

Details: 

ConfirmDetaineeISN_error  “I  heard  the 

detainee’s  ISN  as” 

URL  Expression: 

genlSNumber(DetaineelSN) 

Generic  PromptConfirm_y e  sNo  “If 
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that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

WHEN ( COUNT  =  2 ) 

I  heard  the  detainee’s  ISN  as  [URL 

Continue  with  rec  in  this 

nomatch  noinput 

Expression]  If  that’s  right,  say  ‘yes’.  If 

state. 

maxspeechtimeout 

it’s  not,  say  ‘no’. 

Details: 

ConfirmDetaineeISN_error  “I  heard  the 

detainee’s  ISN  as” 

URL  Expression: 

genlSNumber(DetaineelSN) 

GenericPromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  that  I  heard  the 

Continue  with  rec  in  this 

detainee’s  ISN  correctly.  That  was 

[URL  Expression]  If  that’s  right,  say 

‘yes’.  If  it’s  not,  say  ‘no’. 

state. 

Details: 

ConfirmDetaineeISN_help  “I’d  like  to 

make  sure  that  I  heard  the  detainee’s 

ISN  correctly.  That  was” 

URL  Expression: 

genlSNumber(DetaineelSN) 

Generic  PromptConfirm_yesNo  “If 

that’s  right,  say  ‘yes’.  If  it’s  not,  say 

‘no’.” 
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26.  EngDetaineeAppt#ConfirmVisitationDateTime 

a.  Description 

This  process  confirms  the  date  and  time  of  the  requested  visit  was 
collected.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#GetVisitationTime 

EngDetaineeAppt#GetVisitationDate 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

I  heard  that  you’d  like  to  visit  Abu  Musab  Al-Zarqawi  on  [date:m] 

[50msecs]  [date:d]  [50msecs]  [date:y]  [50msecs]  [TTS  Expression] 

[lOOmsecs]  Is  that  right? 

Details: 

Confirm VisitationDateTime_confirml  “I  heard  that  you’d  like  to  visit” 

DetaineeName  “Abu  Musab  Al-Zarqawi” 

Generic_on  “on” 

TTS  Expression  [date:m]:  DATE_OUT_month 

Silence:  50  msecs 

TTS  Expression  [date:d]:  DATE_OUT_day 

Silence:  50  msecs 

TTS  Expression  [date:y]:  DATE_OUT_year 

Silence:  50  msecs 

TTS  Expression:  TIME_OUT_time  +  1  1  +  TIME_OUT_AM_PM 

Silence:  100  msecs 

GenericPromptConfirm_part2  “Is  that  right?” 
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e.  Grammar: 

EngDetaineeApptConfirmVisitationDateTime.gsWBasicYesN 

o 


NL  Slots 

V  alues 

<confirm> 

no,  yes 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  c 

Pm  sorry. 

EngDetaineeAppt#GetVis 

onfirm  ==  “no” 

Details: 

Generic_imSorry  “Pm  sorry.” 

itationDate 

lastresult$ .  interpretation,  c 

Thanks,  I’ve  submitted  the  details  of  your  request 

Return  to  the  calling 

onfirm  ==  “yes” 

for  this  visit.  Please  call  us  back  in  24  hours  to  see 

if  your  requested  visit  has  been  scheduled. 

Details: 

ConfirmDateTime_post  “Thanks,  I’ve  submitted 

the  details  of  your  request  for  this  visit.  Please  call 

us  back  in  24  hours  to  see  if  your  requested  visit 

has  been  scheduled.” 

dialog 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

I’d  like  to  make  sure  that  I  got  all  the 

details  for  your  request  correctly.  You’d 

Continue  with  rec  in  this 

state. 
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maxspeechtimeout 


like  to  visit  Abu  Musab  Al-Zarqawi  on 
[date:m]  [50msecs]  [date:d]  [50msecs] 
[date:y]  at  [50msecs]  [time:hm]  Is  that 
right? 


Details: 

ConfirmVisitationDateTime_help  “I’d 
like  to  make  sure  that  I  got  all  the  details 
for  your  request  correctly.  You'd  like  to 
visit” 


DetaineeName  “Abu  Musab  Al- 
Zarqawi” 

Generic_on  “on” 

TTS  Expression  [date:m]: 
DATE_OUT_month 
Silence:  50  msecs 
TTS  Expression  [date:d]: 
DATE_OUT_day 
Silence:  50  msecs 
TTS  Expression  [date:y]: 
DATE_OUT_year 
Generic_at  “at” 

Silence:  50  msecs 
TTS  Expression  [time:hm]: 
TIME_OUT_time  +  “  + 
TIME_OUT_AM_PM 


GenericPromptConfirm_part2  “Is  that 


WHEN ( COUNT  =  2 ) 
nomatch  noinput 
maxspeechtimeout 


right?” 

I’d  like  to  make  sure  that  I  got  all  the  Continue  with  rec  in  this 
details  for  your  request  correctly.  You’d  state, 
like  to  visit  Abu  Musab  Al-Zarqawi  on 
[date:m]  [50msecs]  [date:d]  [50msecs] 

[date:y]  at  [50msecs]  [time:hm]  Is  that 
right? 
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Details: 

Confirm VisitationDateTime_help  “I’ d 
like  to  make  sure  that  I  got  all  the  details 
for  your  request  correctly.  You’d  like  to 
visit” 

DetaineeName  “Abu  Musab  Al- 
Zarqawi” 

Generic_on  “on” 

TTS  Expression  [date:m]: 
DATE_OUT_month 
Silence:  50  msecs 
TTS  Expression  [date:d]: 
DATE_OUT_day 
Silence:  50  msecs 
TTS  Expression  [date:y]: 
DATE_OUT_year 
Generic_at  “at” 

Silence:  50  msecs 

TTS  Expression  [time:hm]: 

TIME_OUT_time  +  “  + 

TIME_OUT_AM_PM 

GenericPromptConfirm_part2  “Is  that 

right?” 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

I’d  like  to  make  sure  that  I  got  all  the 

Continue 

with 

details  for  your  request  correctly.  You’d 

like  to  visit  Abu  Musab  Al-Zarqawi  on 

[date:m]  [50msecs]  [date:d]  [50msecs] 

[date:y]  at  [50msecs]  [time:hm]  Is  that 

right? 

rec  in  this  state. 

Details: 
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Confirm VisitationDateTime_help  “I’ d 
like  to  make  sure  that  I  got  all  the  details 
for  your  request  correctly.  You’d  like  to 
visit” 

DetaineeName  “Abu  Musab  Al- 
Zarqawi” 

Generic_on  “on” 

TTS  Expression  [date:m]: 
DATE_OUT_month 
Silence:  50  msecs 
TTS  Expression  [date:d] : 
DATE_OUT_day 
Silence:  50  msecs 
TTS  Expression  [date:y]: 
DATE_OUT_year 
Generic_at  “at” 

Silence:  50  msecs 

TTS  Expression  [time:hm]: 

TIME_OUT_time  +  “  + 

TIME_OUT_AM_PM 

GenericPromptConfirm_part2  “Is  that 

right?” 


27.  EngDetaineeAppt#EnterDetaineeISN 

a.  Description 

This  process  asks  callers  to  enter  a  detainee’s  ISN  to  schedule  a  visit. 
(This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#NewAppointment 

EngDetaineeAppt#ConfirmDetaineeISN 

EngDetaineeAppt#ConfirmDetaineeISN 
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d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Please  say  or  key  in  all  9-digits  of  the  detainee’s  ISN. 

Details: 

EnterDetaineeISN_init  “Please  say  or  key  in  all  9-digits  of  the 

detainee’s  ISN.” 

Entry  Type  =  reentry 

Please  give  me  the  9-digit  ISN  one  more  time. 

Details: 

EnterDetaineeISN_reentry  “Please  give  me  the  9-digit  ISN  one  more 

time.” 

e.  Grammar:  builtin:digits?length=9;minlength=9;maxlength=9 


NL  Slots 

Values 

<userlnput> 

detaineelSN 

Sample  Phrases 

Slots  Filled 

’’one  two  three  four  five  six  seven  eight  nine” 

<built-in  “yes”> 

f  Actions 


Condition 

Action 

Goto 

lastresult  ==  true 

Thanks. 

Details: 

Generic_thanks  “Thanks.” 

— 

Assign:  DetaineelSN  =  lastresult 

EngDetaineeAppt#Confir 

mDetaineelSN 

g.  Error  Behaviors 
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Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

Please  say  or  key-in  the  detainee’s  9- 

Continue  with  rec  in  this 

nomatch  noinput 

digit  ISN. 

state. 

maxspeechtimeout 

Details: 

EnterDetaineeISN_error  “Please  say  or 

key-in  the  detainee’s  9-digit  ISN.” 

WHEN ( COUNT  =  2 ) 

Please  say  or  key-in  the  detainee’s  9- 

Continue  with  rec  in  this 

nomatch  noinput 

digit  ISN. 

state. 

maxspeechtimeout 

Details: 

EnterDetaineeISN_error  “Please  say  or 

key-in  the  detainee’ s  9-digit  ISN.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

Please  say  or  key-in  the  detainee’s  9- 

Continue  with  rec  in  this 

digit  ISN. 

state. 

Details: 

EnterDetaineeISN_error  “Please  say  or 

key-in  the  detainee’s  9-digit  ISN.” 

28.  EngDetaineeAppt#GetVisitationDate 

a.  Description 


This  process  asks  callers  to  specify  a  complete  date  (day,  month,  and  year) 
of  their  requested  visit.  (This  is  a  recognition  state.) 

b.  Special  Features 


c.  Entry  and  Exit  States 


Entry  States 


Exit  States 
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EngDetaineeAppt#CheckDetaineeISN 

EngDetaineeAppt#GetVisitationTime 

EngDetaineeAppt#ConfirmVisitationDateTime 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Please  tell  me  the  date  for  when  you’d  like  to  visit.  Abu  Musab  Al- 

Zarqawi  Please  say  a  complete  date,  including  the  month,  day  and  year. 

For  example,  you  could  say  May  18,  2005. 

Details: 

GetVisitationDate_initPartl  “Please  tell  me  the  date  for  when  you’d 

like  to  visit.” 

DetaineeName  “Abu  Musab  Al-Zarqawi” 

GetVisitationDate_initPart2  “Please  say  a  complete  date,  including  the 

month,  day  and  year.  For  example,  you  could  say  May  18,  2005.” 

Entry  Type  =  reentry 

Please  tell  me  the  full  date  once  again.  For  example,  you  could  say  May 

18,  2005. 

Details: 

GetVisitationDate_reentryPartl  “Please  tell  me  the  full  date  once 

again.” 

GetVisitationDate_reentryPart2  “For  example,  you  could  say  May  18, 

2005.” 

e.  Grammar: 

EngDetaineeAppt_GetVisitationDate.gsl#DATE_VOICE_OR_D 

TMF 


NL  Slots 

V  alues 

<day> 

day 
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<month> 

month 

<year> 

year 

Sample  Phrases 

Slots  Filled 

’’may  thirteenth  nineteen  ninety-nine” 

<day  day> 

<month  month> 

<year  year> 

’’the  thirteenth  of  may  nineteen  ninety  nine” 

<day  day> 

<month  month> 

<year  year> 

’’five  thirteen  nineteen  ninety  nine” 

<day  day> 

<month  month> 

<year  year> 

/.  Actions 


Condition 

Action 

Goto 

Assign:  DATE_OUT_day  = 

lastresult$. interpretation. date. day 

Assign:  DATE_OUT_month  = 

lastresult$. interpretation. date. month 

Assign:  DATE_OUT_year  = 

lastresult$.  interpretation,  date,  year 

Log:  ’ D ATE_OUT_day  is  ‘  +  DATE_OUT_day 

Log:  ’DATE_OUT_month  is  1  + 

DATE_OUT_month 

Log:  ’DATE_OUT_year  is  1  +DATE_OUT_year 

— 

Thanks. 

EngDetaineeAppt#GetVis 

itationTime 

230 


Details: 

Generic_thanks  “Thanks.” 


g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Tell  me  the  date  that  you’d  like  to  visit. 

Abu  Musab  Al-Zarqawi  Please  say  a 

complete  date,  including  the  month,  day 

and  year.  For  example,  you  could  say 

May  18,  2005. 

Continue  with  rec  in  this 

state. 

Details: 

GetVisitationDate_errorPartl  “Tell  me 

the  date  that  you’d  like  to  visit.” 

DetaineeName  “Abu  Musab  Al- 

Zarqawi” 

GetVisitationDate_errorPart2  “Please 

say  a  complete  date,  including  the 

month,  day  and  year.  For  example,  you 

could  say  May  18,  2005.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Tell  me  the  date  that  you’d  like  to  visit. 

Abu  Musab  Al-Zarqawi  Please  say  a 

complete  date,  including  the  month,  day 

and  year.  For  example,  you  could  say 

May  18,  2005. 

Continue  with  rec  in  this 

state. 

Details: 

GetVisitationDate_errorPartl  “Tell  me 

the  date  that  you’d  like  to  visit.” 

DetaineeName  “Abu  Musab  Al- 

Zarqawi” 

GetVisitationDate_errorPart2  “Please 

say  a  complete  date,  including  the 

month,  day  and  year.  For  example,  you 
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could  say  May  18,  2005.” 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

To  set  up  your  appointment,  I  need  to 

Continue  with  rec  in  this 

know  the  date  that  you’d  like  to  visit. 

Abu  Musab  Al-Zarqawi  Please  tell  me 

the  complete  date,  including  the  month, 

day  and  year.  For  example,  you  could 

say  May  18,  2005. 

state. 

Details: 

GetVisitationDate_helpPartl  “To  set  up 

your  appointment,  I  need  to  know  the 

date  that  you’d  like  to  visit.” 

DetaineeName  “Abu  Musab  Al- 

Zarqawi” 

GetVisitationDate_helpPart2  “Please 

tell  me  the  complete  date,  including  the 

month,  day  and  year.  For  example,  you 

could  say  May  18,  2005.” 

29.  EngDetaineeAppt#GetVisitationTime 

a.  Description 

This  process  asks  callers  to  specify  the  hour  and  minute  and  AM/PM  of 
their  requested  visit.  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 


Entry  States 

Exit  States 

EngDetaineeAppt#GetVisitationDate 

EngDetaineeAppt#ConfirmVisitationDateTime 
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d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

Next,  tell  me  the  time  you’d  like  to  visit.  You  can  choose  any  time 

between  the  hours  of  8  AM  to  4  PM. 

Details: 

GetVisitationTime_init  “Next,  tell  me  the  time  you’d  like  to  visit.  You 

can  choose  any  time  between  the  hours  of  8  AM  to  4  PM.” 

e.  Grammar: 

EngDetaineeAppt_GetVisitationTime.gsl#TIME_VOICE_OR_D 

TMF 


NL  Slots 

V  alues 

<am_pm> 

am,  pm 

<hr> 

’’[hour]” 

<min> 

”[min]” 

Sample  Phrases 

Slots  Filled 

”a  quarter  to  six  in  the  morning” 

<am_pm  am> 

’’noon” 

<am_pm  pm> 

<time  0> 

’’two  to  two” 

<time  158> 

’’four  o’clock  p  m” 

<am_pm  pm> 

<time  400> 

f.  Actions 


Condition 

Action 

Goto 

- 

Thanks. 

EngDetaineeAppt#Confir 

mVisitationDateTime 

Details: 
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Generic_thanks  “Thanks.” 

Assign:  TIME_OUT_time  = 
lastresult$. interpretation. hr  + 
+lastresult$. interpretation. min 

Assign:  TIME_OUT_AM_PM  = 
lastresult$. interpretation.  am_pm 


g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

nomatch  noinput 

maxspeechtimeout 

Just  say  the  time  that  you’d  like  to  visit 

Abu  Musab  Al-Zarqawi  You  can  choose 

any  time  between  the  hours  of  8  AM  to 

4  PM.  For  example,  you  can  say,  2  PM. 

Continue  with  rec  in  this 

state. 

Details: 

GetVisitationTime_errorPartl  “Just  say 

the  time  that  you’d  like  to  visit” 

DetaineeName  “Abu  Musab  Al- 

Zarqawi” 

GetVisitationTime_errorPart2  “You  can 

choose  any  time  between  the  hours  of  8 

AM  to  4  PM.  For  example,  you  can  say, 

2  PM.” 

WHEN ( COUNT  =  2 ) 

nomatch  noinput 

maxspeechtimeout 

Tell  me  the  date  that  you’d  like  to  visit. 

Abu  Musab  Al-Zarqawi  You  can  choose 

any  time  between  the  hours  of  8  AM  to 

4  PM.  For  example,  you  can  say,  2  PM. 

Continue  with  rec  in  this 

state. 

Details: 

GetVisitationDate_errorPartl  “Tell  me 

the  date  that  you’d  like  to  visit.” 

DetaineeName  “Abu  Musab  Al- 
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Zarqawi” 

GetVisitationTime_errorPart2  “You  can 
choose  any  time  between  the  hours  of  8 
AM  to  4  PM.  For  example,  you  can  say, 
2  PM.” 


h.  State -Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

To  complete  the  meeting  request,  I  need 

Continue  with  rec  in  this 

to  know  the  time  that  you’d  like  to  visit. 

Abu  Musab  Al-Zarqawi  You  can  choose 

any  time  between  the  hours  of  8  AM  and 

4  PM.  For  example,  you  can  say  2  PM. 

state. 

Details: 

GetVisitationTime_helpPartl  “To 

complete  the  meeting  request,  I  need  to 

know  the  time  that  you’d  like  to  visit.” 

DetaineeName  “Abu  Musab  Al- 

Zarqawi” 

GetVisitationTime_helpPart2  “You  can 

choose  any  time  between  the  hours  of  8 

AM  and  4  PM.  For  example,  you  can 

say  2  PM.” 

30  EngDetaineeAppt#NewAppointment 

a.  Description 

This  process  asks  callers  if  they  have  the  detainee’s  Internment  Serial 
Number  (ISN).  (This  is  a  recognition  state.) 

b.  Special  Features 

c.  Entry  and  Exit  States 
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Entry  States 

Exit  States 

EngDetaineeAppt#EngDetaineeAppt 

EngDetaineeAppt#EnterDetaineeISN 

d.  Pre-rec  Prompts 


Type  and  Condition 

Action 

Entry  Type  =  initial 

In  order  to  make  a  new  appointment,  you  must  have  the  detainee’s 

Internment  Serial  Number,  or  ISN.  Do  you  have  the  ISN? 

Details: 

NewAppointment_init  “In  order  to  make  a  new  appointment,  you  must 

have  the  detainee’s  Internment  Serial  Number,  or  ISN.  Do  you  have  the 

ISN?” 

e.  Grammar: 

EngDetaineeAppt_NewAppointment.gsl#Basic_Yes_No 


NL  Slots 

V  alues 

<confirm> 

yes,  no 

Sample  Phrases 

Slots  Filled 

”no” 

<confirm  no> 

”yes” 

<confirm  yes> 

f.  Actions 


Condition 

Action 

Goto 

lastresult$ .  interpretation,  c 

onfirm  ==  “no” 

In  order  to  make  a  new  appointment  to  visit  a 

detainee,  you  must  have  the  detainee’s  ISN.  Due  to 

security  reasons,  we  cannot  give  you  the  ISN  over 

the  telephone.  But  you  can  get  that  number  by 

going  to  your  local  police  station.  Please  call  back 

once  you  get  it,  and  I’ll  help  you  set  up  your 

Return  to  the  calling 

dialog 
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appointment. 

Details: 

AccessDenial_init  “In  order  to  make  a  new 

appointment  to  visit  a  detainee,  you  must  have  the 

detainee’s  ISN.  Due  to  security  reasons,  we  cannot 

give  you  the  ISN  over  the  telephone.  But  you  can 

get  that  number  by  going  to  your  local  police 

station.  Please  call  back  once  you  get  it,  and  I’ll 

help  you  set  up  your  appointment.” 

lastresult$ .  interpretation,  c 

onfirm  ==  “yes” 

EngDetaineeAppt#EnterD 

etaineelSN 

g.  Error  Behaviors 


Error  Type 

Action 

Goto 

WHEN ( COUNT  =  1  ) 

If  you  have  the  detainee’s  ISN,  say  ‘yes’.  If  you  don’t, 

Continue  with  rec  in 

nomatch  noinput 

say  ‘no’. 

this  state. 

maxspeechtimeout 

Details: 

NewAppointment_error  “If  you  have  the  detainee’s  ISN, 

say  ‘yes’.  If  you  don’t,  say  ‘no’.” 

WHEN ( COUNT  =  2 ) 

If  you  have  the  detainee’s  ISN,  say  ‘yes’.  If  you  don’t. 

Continue  with  rec  in 

nomatch  noinput 

say  ‘no’. 

this  state. 

maxspeechtimeout 

Details: 

NewAppointment_error  “If  you  have  the  detainee’s  ISN, 

say  ‘yes’.  If  you  don’t,  say  ‘no’.” 

h.  State-Specific  Universal  Behaviors 


Universal  Type 

Action 

Goto 

help 

In  order  to  make  a  new  appointment,  you  must  have 

the  detainee’s  Internment  Serial  Number  or  ISN.  If 

Continue  with  rec  in  this 

state. 

237 


you  have  the  ISN,  please  say  ‘yes’,  if  you  don’t,  just 
say  ‘no’  and  I’ll  tell  you  how  to  get  that  information. 

Details: 

NewAppointment_help  “In  order  to  make  a  new 
appointment,  you  must  have  the  detainee’ s 
Internment  Serial  Number  or  ISN.  If  you  have  the 
ISN,  please  say  ‘yes’,  if  you  don’t,  just  say  ‘no’  and 
I’ll  tell  you  how  to  get  that  information.” 


K.  ENGMAINMENU  APPENDICES 


1.  Grammar  and  Slot  Definitions 


Dialog  State 

Grammar 

Slots 

Slot  Values 

EngMainMenu#EngMainMen 

u 

EngMainMenu_EngMainMenu . 

gsl#Sample_Rule 

userlnput 

information,  directions, 

scheduling, 

EngMainMenu#EngVisitInfor 

mation 

EngMainMenu_EngVisitInform 

ation.gsl#Sample_Rule 

Userlnput 

repeatMessage, 

returnMainMenu, 

EngMainMenu#EngDirection 

s 

EngMainMenu_EngDirections .  g 

sl#Sample_Rule 

Userlnput 

repeatDirections, 

returnMainMenu, 

EngScheduling#EngScheduli 

ng 

EngScheduling_EngScheduling. 

gsl#Sample_Rule 

userlnput 

yes,  no, 

EngScheduling#V  oiceEnroll 

ment 

builtin :  digits  ?length=  1 0;minleng 

th=  10;maxlength=  1 0 

userlnput 

accountNbr, 

EngScheduling#ConfirmAcco 

untNbr 

EngScheduling_ConfirmAccoun 

tNbr.gsl#Basic_Yes_No 

confirm 

yes,  no, 

EngScheduling#NbrCountOn 

e 

EngS  cheduling_NbrCountOne .  g 

sl#Sample_Rule 

uselnput 

nbrCount, 

EngS  cheduling#NbrCountT  w 

0 

EngS  cheduling_NbrCountT  wo.  g 

sl#Sample_Rule 

userlnput 

nbrCount, 

EngScheduling#NbrCountThr 

EngS  cheduling_NbrCountThree . 

userlnput 

nbrCount, 
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ee 

gsl#Sample_Rule 

EngScheduling#EnrollmentPi 

n 

builtin :  digits  ?length=4;minlengt 

h=4;maxlength=4 

enrollmentPin 

pinNbr, 

EngScheduling#ConfirmEnro 

llPin 

EngScheduling_ConfirmEnrollP 

in.gsl#Basic_Yes_No 

confirm 

yes,  no, 

EngScheduling#EnrollCheck 

EngScheduling_EnrollCheck.gsl 

#Sample_Rule 

userlnput 

enrollMeNow, 

EngScheduling#V  oice  V  erific 

ation 

builtin:  digits  ?length=  1 0;minleng 

th=  10;maxlength=  1 0 

userlnput 

accountNbr, 

EngScheduling#ConfirmAcco 

untNbr2 

EngScheduling_ConfirmAccoun 

tNbr2.gsl#Basic_Yes_No 

confirm 

yes,  no, 

EngScheduling#NbrCountVer 

ify 

EngS  cheduling_NbrCountV  erifi 

y.gsl#Sample_Rule 

uselnput 

nbrCount, 

EngScheduling#ConfirmSecr 

etDate 

EngScheduling_ConfirmSecret 

Date.gsl#Basic_Yes_No 

confirm 

no,  yes, 

EngScheduling#GetSecretDat 

e 

EngScheduling_GetSecretDate.g 

sl#D  ATE_V  OICE_OR_DT  MF 

day 

month 

year 

day, 

month, 

year. 

EngDetaineeAppt#EngDetain 

eeAppt 

EngDetaineeAppt_EngDetainee 

Appt.gsl#Sample_Rule 

userlnput 

newAppoinment, 

checkAppointment, 

EngDetaineeAppt#NewAppoi 

ntment 

EngDetaineeAppt_New  Appoint 

ment.gsl#Basic_Yes_No 

confirm 

yes,  no, 

EngDetaineeAppt#EnterDetai 

neelSN 

builtin :  digits  ?length=9  ;minlengt 

h=9  ;maxlength=9 

userlnput 

detaineelSN, 

EngDetaineeAppt#ConfirmD 

etaineelSN 

EngDetaineeAppt_ConfirmDeta 

ineeISN.gsl#Basic_Yes_No 

confirm 

yes,  no, 

EngDetaineeAppt#GetVisitati 

onDate 

EngDetaineeAppt_GetVisitation 

Date.gsl#DATE_VOICE_OR_D 

TMF 

day 

month 

year 

day, 

month, 

year. 

EngDetaineeAppt#GetVisitati 

EngDetaineeAppt_GetVisitation 

am_pm 

am,  pm, 

239 


onTime 

Time .  g  sl#TIME_  V  OICE_OR_D 

TMF 

hr 

min 

’’[hour]”, 

”[min]”, 

EngDetaineeAppt#ConfirmVi 

EngDetaineeAppt_ConfirmVisit 

confirm 

no,  yes, 

sitationDateTime 

ationDateTime.gsl#Basic_Yes_ 

No 

2.  Prompt  List 


Prompt  File 

Transcription 

help_universal 

’’Okay,  here’s  some  help.” 

operator_uni  vers  al 

”I’m  sorry,  there  are  no  representatives  available.” 

global_errorl 

’’Sorry.” 

global_error2 

’’Sorry.  I  still  didn’t  get  that.” 

global_error3 

’’Sorry,  we’re  experiencing  some  technical  difficulty  right  now. 

Please  try  again  at  a  later  time.” 

EngMainMenu_init 

’’Please  select  from  the  following  options.  To  get  general  visitor 

information,  including  visiting  hours,  say  ‘information’.  To  get 

directions  to  our  facility,  say  ‘directions’.  To  set  up  a  meeting 

using  our  automated  scheduling  system,  say  ‘scheduling’.” 

Generic_sure 

’’Sure.” 

EngMainMenu_help 

"With  this  system,  you  can  choose  from  the  following  options.  If 

you’d  like  to  get  general  visitor  information  including  visiting 

hours,  say  ‘information’.  If  you’d  like  to  get  directions  to 

Baghdad  Central  Correctional  Facility,  say  ‘directions’.  If  you’d 

like  to  set  up  a  visit  with  a  detainee  using  our  automated 

scheduling  system,  say  ‘scheduling’.” 

EngMainMenu_error 

’’Which  would  you  like  to  do?  get  information,  get  directions,  or 

use  our  automated  scheduling  system.” 

EngVisitInformation_init 

’’Baghdad  Central  Correctional  Facility  is  open  for  detainee 

visitors  from  8  AM  to  4  PM,  Monday  through  Saturday.  Would 

you  like  to  hear  that  information  again  or  return  to  the  main 

menu?  If  you’re  done  for  now,  please  feel  free  to  hang  up.” 
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EngVisitInformation_help 

"To  hear  the  visitation  information  again,  say  ‘repeat’ .  To  return 

to  the  main  menu,  say  ‘main  menu’.  Or  if  you  don’t  need  anything 

else,  say  goodbye  or  just  hang  up.” 

EngVisitInformation_errorl 

’’Which  do  you  want  to  do:  hear  the  visitor  information  again  or 

return  to  the  main  menu?  If  you’re  done,  say  goodbye  or  just  hang 

up.” 

EngVisitInformation_error2 

”If  you  want  to  hear  the  visitor  information  again,  say  ‘repeat’ .  If 

you  want  to  return  to  the  main  menu,  say  ‘main  menu’ .  If  you’re 

done,  say  goodbye  or  just  hang  up.” 

EngDirections_init 

"Baghdad  CenUal  Correctional  Facility  is  located  20  miles  west  of 

Baghdad,  in  the  town  of  Abu  Ghraib.  From  Baghdad,  go  west  on 

highway  six  for  18  miles  then  take  exit  nine  at  Abu  Ghraib.  Our 

facility  is  located  2  miles  southwest  of  exit  nine.  Would  you  like 

to  hear  the  directions  again  or  return  to  the  main  menu?  If  you’re 

done  for  now,  please  feel  free  to  hang  up.” 

EngDirections_help 

"To  hear  the  directions  to  our  facility,  say  ‘repeat’.  To  return  to 

the  main  menu,  say  ‘main  menu’.  If  you  don’t  need  anything  else, 

say  goodbye  or  just  hang  up.” 

EngDirections_error  1 

’’Which  would  you  like  to  do:  hear  the  directions  again  or  return 

to  the  main  menu?  If  you’re  done  for  now,  please  feel  free  to  hang 

up.” 

EngDirections_error2 

"If  you  want  to  hear  the  directions  again,  say  ‘repeat’ .  If  you  want 

to  return  to  the  main  menu,  say  ‘main  menu’.  If  you’re  done,  say 

goodbye  or  just  hang  up.” 

EngScheduling_init 

”In  order  to  use  our  automated  scheduling  system,  you  must  be  an 

enrolled  user.  Are  you  an  enrolled  user?  If  you  are,  say  ‘yes’.  If 

you’re  not,  say  ‘no’  and  I’ll  help  you  to  enroll  in  our  system.” 

Generic_thanks 

’’Thanks.” 

EngScheduling_help 

”In  order  to  use  our  automated  scheduling  system,  you  must  be  an 

enrolled  user.  If  you  are  already  enrolled  in  our  automated 

scheduling  system,  say  ‘yes'.  If  you’re  not,  say  ‘no’  and  I'll  help 

you  to  enroll  in  our  system.” 
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EngScheduling_error  1 

”If  you’re  enrolled,  say  ‘yes’.  If  you’re  not,  say  ‘no’  and  I’ll  help 

you  to  enroll  in  our  system.” 

EngScheduling_error2 

”If  you’re  already  enrolled  in  our  system,  say  ‘yes’.  If  you’re  not 

or  if  you’re  not  sure,  say  ‘no’,  and  I'll  help  you  to  enroll  in  our 

system.” 

VoiceEnrollment_init 

"To  get  started  on  the  voice  enrollment  process,  I  need  your  10- 

digit  account  number.  If  you  don’ t  have  an  account  number,  or  if 

you’ve  lost  it,  please  go  to  your  nearest  police  station  to  register 

for  a  new  account.  If  you  have  the  account  number,  go  ahead  and 

say  or  key  it  in  now.” 

V  oiceEnrollment_reentry 

’’Please  say  or  key-in  your  10-digit  account  number  one  more 

time.” 

V  oiceEnrollment_help 

"In  order  to  enroll  in  our  automated  scheduling  system,  you  must 

have  a  10-digit  account  number.  If  you  don’t  have  your  account 

number  or  if  you’ve  lost  it,  please  hang  up  and  go  to  your  local 

police  station  to  register  for  a  new  account.  If  you  have  your 

account  number,  please  say  or  key-in  the  number  now.” 

V  oiceEnrollment_error  1 

’’Please  say  or  key-in  your  10-digit  account  number.” 

V  oiceEnrollment_error2 

”To  get  you  started  on  the  voice  enrollment  process,  I  need  to 

have  your  10-digit  account  number.  Please  key  it  in,  or  say  ‘help’ 

for  more  information.” 

Generic_imSorry 

”I’m  sorry.” 

Generic_great 

’’Great!” 

NbrCountOne_init 

’’Now,  to  create  your  voiceprint,  first  I'll  ask  you  to  count  from  1 

to  9,  three  separate  times,  so  that  the  system  can  analyze  your 

voice.  Then  I'll  ask  you  for  some  secret  information  that  we  might 

need  to  get  from  you  occasionally,  just  for  extra  security.  So  to  get 

started,  please  count  out  loud,  once  from  1  to  9  like  this,  one,  two, 

three,  and  so  on.” 

NbrCount_help 

”In  order  to  create  your  voiceprint,  please  count  out  loud,  once 

from  1  to  9  like  this,  one,  two,  three,  and  so  on.” 

NbrCount_error 


’’Please  count  out  loud,  once,  from  1  to  9  like  this  one,  two,  three. 


and  so  on.” 


NbrC  ountT  wo_init 

"And,  once  more,  please?” 

NbrCountThree_init 

"And  one  last  time.” 

EnrollmentPin_init 

’’Next,  I  need  to  get  the  4-digit  enrollment  code  from  the 

enrollment  notice  that  we  sent  you.  So  take  a  moment  to  find  that 

code  now,  and  when  you’re  ready,  go  ahead  and  say  it,  or  just  key 

it  in.” 

EnrollmentPin_reentry 

’’Please  say  or  key  in  your  4-digit  enrollment  code  again.” 

EnrollmentPin_help 

’’Please  say  or  key  in  your  4-digit  enrollment  code  from  the 

enrollment  notice  that  we  sent  you.” 

EnrollmentPin_error 

’’Please  say  or  key  in  your  4-digit  enrollment  code.” 

EnrollCheck_init 

’’Now  it  looks  like  we  haven't  yet  enrolled  you  in  our  Voiceprint 

Verification  System.  This'll  let  us  identify  you  using  your  unique 

voiceprint,  which  is  faster  and  more  convenient  that  a  PIN  or 

password.  We  only  need  to  enroll  you  once,  and  it’ll  just  take  a 

minute.  To  go  ahead  with  the  enrollment  process  right  now,  say 

‘enroll  me  now’ .” 

EnrollCheck_help 

”To  go  ahead  with  the  enrollment  process  right  now,  say  ‘enroll 

me  now’.” 

EnrollCheck_error 

”To  get  started  on  the  enrollment  process,  say  ‘enroll  me  now’.” 

V  oice  V  erification_init 

"To  get  started,  go  ahead  and  say  or  key-in  your  10-digit  account 

number.” 

V  oice  V  erification_reentry 

’’Please  say  or  key-in  your  10-digit  account  number  one  more 

time.” 

V  oice  V  erification_help 

”To  get  started  on  the  voice  verification  process,  please  say  or 

key-in  your  10-digit  account  number.  If  you  don’t  have  a  10-digit 

account  number  or  if  you’ve  lost  it,  please  go  to  your  local  police 

station  to  register  for  a  new  account.  If  you  have  the  number, 

please  go  ahead  and  say  or  key  it  in  now.” 

VoiceVerific  ation_error  1 

’’Please  say  or  key-in  your  10-digit  account  number.” 

243 


V  oice  V  erification_error2 


’’Please  key-in  your  10-digit  account  number  or  say  ‘help’  for 
more  information.” 


NbrCountVerify_init  ’’Now  to  verify  your  voice,  please  count  out  loud  from  one  up  to 

nine.” 


NbrCountVerify_post 

’’You’re  been  verified.” 

NbrC  ount  V  erify_help 

”In  order  to  verify  your  account,  please  count  out  loud  once  from 

1  to  9  like  this,  one,  two,  three  and  so  on.” 

RemindDate_init 

’’Now  think  of  a  hint  that'll  remind  you  of  that  date.  After  you 

hear  the  beep,  tell  me  that  hint  and  we'll  record  it  so  that  we  can 

play  it  back  to  you  later.  So,  for  example,  you  might  say  my 

mother’s  birthday  or  my  graduation  date.” 

RemindDate_post 

”OK!  we’ve  successfully  enrolled  your  voiceprint.” 

RemindDate_error 

’’Please  tell  me  a  hint  that  will  remind  you  of  your  secret  date.” 

GetSecretDate_init 

’’Next  I'll  get  the  secret  information  that  we'll  ask  you  for 

occasionally.  This'll  be  a  date  that’s  easy  for  you  to  remember, 

but  hard  for  others  to  guess,  like  a  special  anniversary  or  a 

friend's  birthday.  So,  think  of  the  secret  date  you’d  like  to  use, 

and  when  you’re  ready,  just  tell  me  that  date,  including  the  year, 

like  this  April  1st  1998.” 

GetSecretDate_reentry 

’’Please  reenter  your  secret  date,  like  this,  April  1st  1998.” 

GetSecretDate_help 

’’Please  enter  a  secret  date  that’s  easy  for  you  to  remember,  but 

hard  for  others  to  guess.  When  you’re  ready,  just  tell  me  that  date, 

including  the  year,  like  this  April  1st  1998.” 

GetSecretDate_errorl 

"Please  say  or  key  in  your  secret  date,  like  this,  April  1st  1998.” 

GetSecretDate_error2 

"Please  enter  a  date  that’s  easy  for  you  to  remember,  but  hard  for 

others  to  guess,  like  a  special  anniversary  or  a  friend’s  birthday. 

So,  think  of  the  secret  date  you’d  like  to  use,  and  when  you’re 

ready,  just  tell  me  that  date,  including  the  year,  like  this  April  1st 

1998.” 

EngDetaineeAppt_init 

’’Next,  please  select  from  the  following  options.  If  you’d  like  to 

make  a  new  appointment,  say  ‘new  appointment'.  If  you’d  like  to 
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check  the  status  of  a  pending  appointment,  say  ‘check 

appointment’ .” 

EngDetaineeAppt_help 

”If  you'd  like  to  make  a  new  appointment  to  meet  with  a  detainee, 

say  ‘new  appointment’.  If  you’d  like  to  check  a  pending 

appointment  to  see  if  it  has  been  scheduled,  say  ‘check 

appointment’ 

EngDetaineeAppt_errorl 

’’Which  did  you  want  to  do:  set  up  a  new  appointment  or  check  a 

pending  appointment?” 

EngDetaineeAppt_error2 

"To  set  up  a  new  appointment  now,  say  ‘new  appointment'.  To 

check  a  pending  appointment,  say  ‘check  appointment' .” 

NewAppointment_init 

”In  order  to  make  a  new  appointment,  you  must  have  the 

detainee’s  Internment  Serial  Number,  or  ISN.  Do  you  have  the 

ISN?” 

Acces  sDenial_init 

”In  order  to  make  a  new  appointment  to  visit  a  detainee,  you  must 

have  the  detainee’s  ISN.  Due  to  security  reasons,  we  cannot  give 

you  the  ISN  over  the  telephone.  But  you  can  get  that  number  by 

going  to  your  local  police  station.  Please  call  back  once  you  get  it, 

and  I’ll  help  you  set  up  your  appointment.” 

NewAppointment_help 

”In  order  to  make  a  new  appointment,  you  must  have  the 

detainee’s  Internment  Serial  Number  or  ISN.  If  you  have  the  ISN, 

please  say  ‘yes’,  if  you  don’t,  just  say  ‘no’  and  I'll  tell  you  how  to 

get  that  information.” 

NewAppointment_error 

”If  you  have  the  detainee’s  ISN,  say  ‘yes’.  If  you  don't,  say  ‘no’.” 

EnterDetaineeISN_init 

’’Please  say  or  key  in  all  9-digits  of  the  detainee’s  ISN.” 

EnterDetaineeISN_reentry 

’’Please  give  me  the  9-digit  ISN  one  more  time.” 

EnterDetaineeISN_error 

’’Please  say  or  key-in  the  detainee’s  9-digit  ISN.” 

CheckAppointment_init 

’’Based  on  our  records,  you  have  no  scheduled  appointments  at 

this  time.  If  you’ve  called  earlier  to  set  up  an  appointment,  note 

that  it  takes  24  hours  for  the  appointment  to  get  scheduled.  Please 

check  back  at  a  later  time.” 

GetVisitationTime_init 

’’Next,  tell  me  the  time  you’d  like  to  visit.  You  can  choose  any 
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time  between  the  hours  of  8  AM  to  4  PM.” 

ConfirmDateTime_post 

"Thanks,  I’ve  submitted  the  details  of  your  request  for  this  visit. 

Please  call  us  back  in  24  hours  to  see  if  your  requested  visit  has 

been  scheduled.” 

Generic  PromptC  onfirm_part  1 

”1  heard” 

Generic  PromptC  onfirm_part2 

”Is  that  right?” 

ConfirmAccountNbr_help 

’’I'd  like  to  make  sure  that  I  heard  your  account  number  correctly. 

That  was” 

Generic  PromptC  onfirm_ye  sNo 

”If  that’s  right,  say  ‘yes’.  If  it’s  not,  say  ‘no’.” 

ConfirmAccountNbr_error 

”1  got  your  account  number  as” 

ConfirmEnrollmentPin_help 

”I'd  like  to  make  sure  that  I  heard  your  enrollment  code  correctly. 

That  code  was” 

ConfirmEnrollmentPin_error 

”1  got  your  secret  date  as” 

Confirms  ecretD  ate_help 

”I'd  like  to  make  sure  I  got  your  secret  date  correctly.  If  your 

secret  date  is” 

C  onfirmS  ecretD  ate_error 

”I'd  like  to  make  sure  I  got  your  secret  date  correctly.  I  heard  the 

date  as” 

ConfirmDetaineelS  N_help 

”I’d  like  to  make  sure  that  I  heard  the  detainee’s  ISN  correctly. 

That  was” 

ConfirmDetaineeISN_error 

”1  heard  the  detainee’s  ISN  as” 

CheckDetaineeISN_initPart  1 

’’Next,  please  wait  while  I  check  to  see  if  you’re  a  registered 

visitor  of  the  detainee  with  ISN” 

CheckDetaineeISN_initPart2 

’’Thanks.  I’ve  confirmed  that  you’re  a  registered  visitor  of’ 

DetaineeName 

”Abu  Musab  Al-Zarqawi” 

GetVisitationDate_initPartl 

’’Please  tell  me  the  date  for  when  you’d  like  to  visit.” 

GetVisitationDate_initPart2 

’’Please  say  a  complete  date,  including  the  month,  day  and  year. 

For  example,  you  could  say  May  18,  2005.” 

GetVisitationDate_reentryPartl 

"Please  tell  me  the  full  date  once  again.” 
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GetVisitationDate_reentryPart2 


’’For  example,  you  could  say  May  18,  2005.” 


GetVisitationDate_helpPart  1 

”To  set  up  your  appointment,  I  need  to  know  the  date  that  you’d 

like  to  visit.” 

GetVisitationDate_helpPart2 

’’Please  tell  me  the  complete  date,  including  the  month,  day  and 

year.  For  example,  you  could  say  May  18,  2005.” 

GetVisitationDate_errorPart  1 

"Tell  me  the  date  that  you'd  like  to  visit.” 

GetVisitationDate_errorPart2 

’’Please  say  a  complete  date,  including  the  month,  day  and  year. 

For  example,  you  could  say  May  18,  2005.” 

GetVisitationTime_helpPartl 

"To  complete  the  meeting  request,  I  need  to  know  the  time  that 

you'd  like  to  visit.” 

GetVisitationTime_helpPart2 

’’You  can  choose  any  time  between  the  hours  of  8  AM  and  4  PM. 

For  example,  you  can  say  2  PM.” 

GetVisitationTime_errorPart  1 

’’Just  say  the  time  that  you'd  like  to  visit” 

GetVisitationTime_errorPart2 

’’You  can  choose  any  time  between  the  hours  of  8  AM  to  4  PM. 

For  example,  you  can  say,  2  PM.” 

ConfirmVisitationDateTime_confirml 

”1  heard  that  you'd  like  to  visit” 

Generic_on 

”on” 

ConfirmVisitationDateTime_help 

”I'd  like  to  make  sure  that  I  got  all  the  details  for  your  request 

correctly.  You’d  like  to  visit” 

Generic_at 

”at” 
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APPENDIX  B.  NPS  SPEAKER  VERIFICATION  TEST 
INVITATION  LETTER 


14  April  2005 

From:  Mr.  James  Ehlert,  Naval  Postgraduate  School  (NPS),  Information  Sciences  Department 
To:  Prospective  Participants 

Sub] :  INVITATION  LETTER  FOR  NPS  VOICE  ENROLLMENT  AND  VERIFICATION  TEST. 

Enel:  (1)  Sample  Voice  Enrollment  and  Verification  Call-flow 

(2)  Participant  Consent  Form 

(3)  Minimal  Risk  Consent  Statement 

(4)  Privacy  Act  Statement 

(5)  User  Feedback  Questionnaire 

Ladies  and  Gentlemen, 

1.  On  behalf  of  the  Naval  Postgraduate  School  (NPS),  I  would  like  to  respectfully  request  your 
participation  in  a  voice  verification  test  (dates  provided  below).  The  research  program  is  conducted  by 
NPS  and  is  sponsored  by  the  Office  of  Secretary  of  Defense  (OSD).  The  test  will  attempt  to  study  the 
feasibility  of  remote  voice  enrollment  and  voice  verification  in  support  of  War  on  Terrorism  (WoT) 
security  requirements.  During  this  test  NPS  will  evaluate  the  voice  verification  accuracy  of  a 
commercially  packaged  voice  verification  application  called  Nuance  Caller  Authentication  (NCA)  1.0 
provided  by  Nuance  Communications  Inc. 


2.  Test  Period.  Tire  voice  verification  test  will  be  conducted  in  two  phases,  as  described  below: 


Date 

Event 

Remark 

20-24  Apr  05 

(Wed-Sun) 

Initial  Voice  Enrollment 
& 

Voice  Verification  Testing 

The  voice  i>erification  system  will  be  operational  from 

Wednesday,  April  20, 12:00  AM  (PST)  to  Sunday,  April  24, 
11:59  PM  (PST). 

2-8  May  05 

(Mon-Sun) 

Voice  Verification  Testing 

The  voice  verification  system  will  be  operational  from  Monday, 
May  2, 12:00  AM  (PST)  to  Sunday,  May  8,  2005  11:59  PM  ‘ 
(PST). 

For  the  initial  voice  enrollment  and  verification  testing  (20-24  Apr  05)  please  call  one  of  the  following 
telephone  numbers  listed  below,  six  separate  times  during  the  first  test  period:  once  to  enroll  your  voice 
biometric  and  five  times  to  verify  your  voice  biometric.  Please  space  out  the  frequency  of  your  calls  to 
the  system  with  a  minimum  of  4-hours  in  between  each  call. 

And  for  subsequent  voice  verification  testing  (2-8  May  05)  please  call  the  system  again,  four  separate 
times  to  verify  your  voice  biometric,  for  a  total  of  ten  calls  for  the  entire  voice  verification  test. 

■  (831)  656-1905 

■  (831)  656-1906 

■  (831)  656-1907 
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Note:  Due  to  a  large  nu  mber  of  users,  the  system  may  be  busy;  in  this  case  please  call  one  of  the  other  telephone 
numbers  listed  above  or  try  again  at  a  later  time.  Also,  it  is  not  necessary  to  enroll  and  verify  your  voice  biometric 
on  the  same  telephone  number,  you  may  enroll  using  one  of  the  listed  telephone  number  above  and  verify  on  another, 
all  three  telephone  numbers  are  linked  to  the  same  database.  Your  participation  is  very  important  for  the  success  of 
this  project. 

3.  Test  Instructions. 

As  a  participant,  please  respond  to  system  prompts.  The  voice  enrollment  process  will  take  less  than  two 
minutes  to  complete  and  the  verification  process  will  take  less  than  a  minute.  Enclosure  (1)  is  provided  to 
demonstrate  the  call  flow  dialog  of  the  enrollment  and  verification  process. 

During  the  initial  enrollment  phase,  the  system  will  ask  you  for  a  10-digit  account  number.  NPS 
recommends  using  your  telephone  number  but  any  10-digit  number  will  suffice.  NPS  also  recommends 
participants  write  down  their  10-digit  number  since  it  is  the  unique  identifier  that  matches  your  voice 
sample  to  your  stored  voice  biometric. 

In  addition  to  the  10-digit  number,  the  system  will  also  ask  you  for  a  4-digit  enrollment  pin  code,  please 
use  any  4-digit  code  for  the  enrollment  pin  code.  It  is  not  necessary  to  remember  the  4-digit  PIN  once 
you  have  enrolled  in  the  system. 

4.  Consent  Forms.  In  order  to  participate  in  this  test,  please  sign  and  complete  the  following  enclosed 
forms  (see  below)  and  send  it  via  email  to  sklee@nps.edu  or  via  fax  to  (831)  656-3679,  attention:  Capl 
Samuel  Lee.  These  forms  are  to  ensure  your  privacy  and  to  ensure  you  that  the  data  collected  in  support 
of  this  test  will  be  kept  in  strict  confidentiality. 

Note:  The  system  will  not  ask  you  for  any  sensitive  in  formation  like  name,  social  security  number,  and  etc. 

•  Participant  Consent  Form  (see  Enclosure  2) 

•  Minimal  Risk  Consent  Statement  (see  Enclosure  3) 

•  Privacy  Act  Statement  (see  Enclosure  4) 

5.  Test  Feedback.  Lastly,  upon  completion  of  this  test,  please  fill  out  the  attached  User  Feedback 
Questionnaire  (see  Enclosure  5)  and  send  it  via  email  to  sklee@nps.edu  or  via  fax  to  (831)  656-3679, 
attention:  Capt  Samuel  Lee.  Your  feedback  is  very  important  to  us. 

6.  The  NPS  greatly  appreciates  your  participation  in  this  test.  If  there  are  any  questions  please  contact 
my  points-of-contact  in  this  matter:  Capt  Samuel  Lee  at  (831)  869-9638  or  via  email  at  sklee@nps.edu,  or 
Dr.  Pat  Sankar  at  (714)  206-7685  or  via  email  at  pvsankar@nps.edu. 

Very  Respectfully, 

James  Ehlert 

NSA  Cryptologic  Research  Chair 
Naval  Postgraduate  School 
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SAMPLE  NCA  SYSTEM  ENROLLMENT  CALL  FLOW 

System:  Thanks  for  calling  Nuance  Caller  Authentication,  powered  by  Nuance  Verifier!  To  get  started,  go  ahead  and  say  or  key- 
in  your  10-digit  account  number. 

Caller:  (Speech  orDTMF entry)  8005551212 

System:  Thanks.  I  heard  800555121  2.  Is  that  right ? 

Caller:  Yes. 

System:  Thanks.  And  next,  I  need  to  get  the  4-digit  enrollment  code  from  the  enrollment  notice  that  we  sent  you.  So  take  a 
moment  to  find  that  code  now,  and  when  you  ’ re  ready,  go  ahead  and  say  it,  or  just  key  it  in. 

Caller:  12  34 

System:  Thanks.  I  heard  1  2  3  4.1s  that  right? 

Caller:  Yes. 

System:  Great.  Now,  it  looks  like  we  haven  ’tyet  enrolled  you  in  the  Voicepiint  Verification  System.  This'll  let  us  identify  you 
using  your  unique  voiceprint,  which  is  faster  and  more  convenient  than  a  PIN  or  password.  We  only  need  to  enroll  you  once,  and 
it’ll  just  take  a  minute.  If  you ’d  like  more  information  about  voice  verification  before  we  get  started,  just  say  ‘tell  me  more.  ’ 
Otherwise,  to  go  ahead  with  the  enrollment  process  right  now,  say  “enroll  me  now.  ” 

Caller:  Enroll  me  now. 

System:  OK.  Now,  to  create  your  voiceprint,  first  I’ll  ask  you  to  count  from  1  to  9,  three  separate  times,  so  that  the  system  can 
analyze  your  voice.  Then  I’ll  ask  you  for  some  secret  information  that  we  might  need  to  get  from  you  occasionally,  just  for  extra 
security.  So  to  get  started,  please  count  out  loud,  once,  from  1  to  9  like  this:  one,  two,  three,  and  so  on. 

Caller:  123456789 

System:  And,  once  more,  please? 

Caller:  123456789 

System:  And  one  last  time. 

Caller:  123456789 

System:  Thanks.  Now,  next,  I'll  get  the  secret  information  that  we  ’ll  ask  you  for  occasionally.  This  ’ll  be  a  date  that’s  easy  for 
you  to  remember,  but  hard  for  others  to  guess,  like  a  special  anniversary  or  a  friend’s  birthday.  So,  think  of  the  secret  date  you  ’d 
like  to  use,  and  when  you  ’re  ready,  just  tell  me  that  date,  including  the  year,  like  this:  ‘April  1st,  1998.  ’  Or  say,  7  want  to  enter 
it  using  touch-tones.  ’ 

Caller:  November  10th,  1998. 

System:  I  heard  that  date  as:  November  10th,  1998.  Did  I  get  that  right? 

Caller:  Yes. 

System:  Great.  Now,  think  of  a  hint  that'll  remind  you  of  that  date.  After  you  hear  the  beep,  tell  me  that  hint  and  we  ’ll  record  it  so 
that  we  can  play  it  back  to  you  later.  So,  for  example,  you  might  say  ‘my  mother ’s  birthday,  ’  or  ‘my  graduation  date.  ’  (Hard¬ 
coded  system  beep) 

Caller:  My  cat’s  birthday. 

System:  OK!  We’ve  successfully  enrolled  your  voiceprint.  Thanks  for  calling  Nuance  Caller  Authentication.  Goodbye! 
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SAMPLE  NCA  SYSTEM  VOICE  AUTHENTICATION  CALL  FLOW 

Scenario  1.  In  the  first  scenario,  the  system  is  “sure”  of  the  decision  after  the  first  Enrollment  Digit  String  (EDS) 
utterance. 

System:  Welcome  to  Nuance  Caller  Authentication,  powered  by  Nuance  Verifier. 

To  get  started,  go  ahead  and  say  or  key-in  your  1 0-digit  account  number. 

Caller:  8  0  0  5  5  51212. 

System:  Thanks.  I  heard:  800555121  2.  Did  I  get  that  right? 

Caller:  Yes. 

System:  Thanks.  Now,  to  verify  your  voice,  please  count  out  loud  from  one  up  to  nine. 

Caller:  12  3  4  5  6  7  8  9. 

System:  You ’ve  been  verified. 


Scenario  2.  In  the  second  scenario,  the  system  is  “unsure”  of  the  decision  even  after  two  repetitions  of  the  EDS,  and 
uses  knowledge  verification  (where  the  knowledge  is  a  secret  date  selected  by  the  caller  at  enrollment  time)  to  make 
the  final  decision. 

System:  Welcome  to  Nuance  Caller  Authentication,  powered  by  Nuance  Verifier. 

To  get  started,  go  ahead  and  say  or  lcey-in  your  1 0-digit  account  number. 

Caller:  8  0  0  5  5  51212. 

System:  Thanks.  I  heard:  800555121  2.  Did  I  get  that  right? 

Caller:  Yes. 

System:  Thanks.  Now,  to  verify  your  voice,  please  count  out  loud  from  one  up  to  nine. 

Caller:  123456789. 

System:  And,  once  more,  please? 

Caller:  1  2  3  4  5  6  7  8  9. 

System:  OK.  And  finally,  think  of  the  date  that  answers  this  hint: 

(Playback  of  caller ’s  recorded  hint) 

"My  cat’s  birthday. " 

Now,  give  me  that  date,  including  the  year.  You  can  either  say  it,  or  use  your  touch  tone  keypad  to  enter  the  8  digits  that  represent 
it,  using  2  digits  for  the  month,  2  for  the  day,  and  4  for  the  year. 

Caller:  November  10th,  1998 

System:  Great.  You’ve  been  verified. 
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PARTICIPANT  CONSENT  FORM 

Introduction.  You  are  invited  to  participate  in  Naval  Postgraduate  School’s  (NPS)  Voice  Enrollment  and 
Verification  Test.  This  test  is  in  support  of  NPS’s  Iraqi  Enrollment  via  Voice  Authentication  Project  (IEVAP).  The 
research  program  is  conducted  by  NPS  and  is  sponsored  by  the  Office  of  Secretary  of  Defense  (OSD).  The  test  will 
attempt  to  study  the  feasibility  of  remote  voice  enrollment  and  voice  verification  in  support  of  War  on  Terrorism 
(WoT)  security  requirements.  During  this  test  NPS  will  evaluate  the  voice  verification  accuracy  of  a  commercially 
packaged  voice  verification  application  called  Nuance  Caller  Authentication  (NCA)  1 .0  provided  by  Nuance 
Communications  Inc. 

Background  Information.  The  Naval  Postgraduate  School's  Voice  Authentication  Research  Team  is  conducting 
this  study. 

Procedures.  If  you  agree  to  participate  in  this  study,  the  researcher  will  explain  the  tasks  in  detail.  There  will  be 
ten  required  session:  User  will  enroll  and  verity  their  voice  biometric  by  calling  into  ASR  phone  system  during 
which  you  will  be  expected  to  accomplish  a  number  of  tasks  related  to  remote  voice  enrollment  and  verification. 

Risks  and  Benefits.  This  research  involves  no  risks.  The  benefits  to  the  participants  are  gaining  techniques  for  the 
demonstration  of  this  technology  for  subsequent  research  and  development. 

Compensation.  There  is  no  compensated  for  participating  in  this  study.  A  copy  of  the  test  results  will  be  available 
to  you  at  the  conclusion  of  the  experiment. 

Confidentiality.  The  records  of  this  sUidy  will  be  kept  confidential.  No  information  will  be  publicly  accessible 
which  could  identify  you  as  a  participant. 

Voluntary  Nature  of  the  Study.  If  you  agree  to  participate,  you  are  free  to  withdraw  from  the  study  at  any  time 
without  prejudice.  You  will  be  provided  a  copy  of  this  form  for  your  records. 

Points  of  Contact.  If  you  have  any  further  questions  or  comments  after  the  completion  of  the  study,  you  may 
contact  the  research  supervisor,  Mr.  James  Ehlert  at  (831)  656-3002,  jfehlert@nps.navy.mil. 

Statement  of  Consent.  I  have  read  the  above  information.  I  have  asked  all  questions  and  have  had  my  questions 
answered.  I  agree  to  participate  in  this  sUidy. 


Participant’s  Signature  Date 


Researcher’s  Signature  Date 
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MINIMAL  RISK  CONSENT  STATEMENT 
NAVAL  POSTGRADUATE  SCHOOL,  MONTEREY,  CA  93943 

Participant:  VOLUNTARY  CONSENT  TO  BE  A  RESEARCH  PARTICIPANT  IN:  THE  DEMONSTRATION  OF 
THE  VOICE  VERIFICATION  TECHNOLOGY  IN  SUPPORT  OF  IRAQI  ENROLLMENT  VIA  VOICE 
AUTHENTICATION  PROJECT  (IEVAP). 

I  have  read,  understand  and  been  provided  "Information  for  Participants"  that  provides  the  details  of  the  below 
acknowledgments. 

I  understand  that  this  project  involves  research.  An  explanation  of  the  purposes  of  the  research,  a  description  of 
procedures  to  be  used,  identification  of  experimental  procedures,  and  the  extended  duration  of  my  participation  have 
been  provided  to  me. 

I  understand  that  this  project  does  not  involve  more  than  minimal  risk.  I  have  been  informed  of  any  reasonably 
foreseeable  risks  or  discomforts  to  me. 

I  have  been  informed  of  any  benefits  to  me  or  to  others  that  may  reasonably  be  expected  from  the  research. 

I  have  signed  a  statement  describing  the  extent  to  which  confidentiality  of  records  identifying  me  will  be 
maintained. 

I  have  been  informed  of  any  compensation  and/or  medical  treatments  available  if  injury  occurs  and  is  so,  what  they 
consist  of,  or  where  further  information  may  be  obtained. 

I  understand  that  my  participation  in  this  project  is  voluntary;  refusal  to  participate  will  involve  no  penalty  or  loss  of 
benefits  to  which  I  am  otherwise  entitled.  I  also  understand  that  I  may  discontinue  participation  at  any  time  without 
penalty  or  loss  of  benefits  to  which 

I  am  otherwise  entitled. 

I  understand  that  the  individual  to  contact  should  I  need  answers  to  pertinent  questions  about  the  research  is  Mr. 
James  Ehlert,  Principal  Investigator.  A  full  and  responsive  discussion  of  the  elements  of  this  project  and  my  consent 
has  taken  place. 


Signature  of  Principal  Investigator  Date 


Signature  of  Volunteer  Date 
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PRIVACY  ACT  STATEMENT 

NAVAL  POSTGRADUATE  SCHOOL,  MONTEREY,  CA  93943 
PRIVACY  ACT  STATEMENT 


Purpose:  The  purpose  of  this  research  is  to  create  a  pilot  POC  system  using  existing  commercial  off  the  shelf 
(COTS)  Automated  Speech  Recognition  (ASR)  technology  and  COTS  Voice  Verification  (VV)  technology  in  order 
to  expedite  a  visitor’s  entry  to  a  controlled  facility/secure  space. 

This  research  initiates  a  series  of  investigations  into  the  application  of  voice  technologies  by  developing  a  pilot  POC 
system  that  integrates  ASR  and  VV  technology  into  a  mobile  platform  in  order  to  demonstrate  a  functionality  that 
does  not  exist  in  order  to  meet  war-fighter  requirements.  Specifically,  this  research  is  intended  to  contribute  toward 
the  future  employment  of  voice  authentication  technologies  in  a  variety  of  coalition  military  operations. 

Lise:  Data  collected  front  this  research  will  be  used  for  statistical  analysis  by  the  Departments  of  the  Navy  and 
Defense,  and  other  U.S.  Government  agencies,  provided  this  use  is  compatible  with  the  purpose  for  which  the 
information  was  collected.  Use  of  the  information  may  be  granted  to  legitimate  non-government  agencies  or 
individuals  by  the  Naval  Postgraduate  School  in  accordance  with  the  provisions  of  the  Freedom  of  Information  Act. 


Disclosure/Confidentiality: 

I  have  been  assured  that  my  privacy  will  be  safeguarded.  I  will  be  assigned  a  control  or  code  number  that  thereafter 
will  be  the  only  identifying  entry  on  any  of  the  research  records.  The  Principal  Investigator  will  maintain  the  cross- 
reference  between  name  and  control  number.  It  will  be  decoded  only  when  beneficial  to  me  or  if  some 
circumstances,  which  is  not  apparent  at  this  time,  would  make  it  clear  that  decoding  would  enhance  the  value  of  the 
research  data.  In  all  cases,  the  provisions  of  the  Privacy  Act  Statement  will  be  honored. 

I  understand  that  a  record  of  the  information  contained  in  this  Consent  Statement  or  derived  from  the  experiment 
described  herein  will  be  retained  permanently  at  the  Naval  Postgraduate  School  or  by  higher  authority.  I  voluntarily 
agree  to  its  disclosure  to  agencies  or  individuals  indicated  in  paragraph  3  and  I  have  been  informed  that  failure  to 
agree  to  such  disclosure  may  negate  the  purpose  for  which  the  experiment  was  conducted. 
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USER  FEEDBACK  QUESTIONNAIRE 

1 .  What  10-digit  number  did  you  use  to  enroll  and  verify  your  voice  biometric? 


2.  What  medium  did  you  use  to  conduct  voice  enrollment?  (Circle  one) 

a.  Landline  telephone 

b.  Cellular  telephone 

c.  VoIP  phone 

d.  Microphone  &  speaker 

3.  What  medium  did  you  use  to  conduct  voice  verification?  (Circle  all  that  applies) 

a.  Landline  telephone 

b.  Cellular  telephone 

c.  VoIP  phone 

d.  Microphone  &  speaker 

4.  What  is  your  overall  opinion  of  this  form  of  biometric  technology?  (Circle  one) 

a.  strongly  in  favor 

b.  moderately  in  favor 

c.  no  opinion 

d.  moderately  opposed 

e.  strongly  opposed 

5.  Did  you  experience  any  problems  during  the  voice  enrollment  process?  (Circle  one)  YES  NO 

If  so,  please  provide  detail  in  box,  to  include  date  and  time  of  call.  For  additional  space,  please  use  back  of  sheet. 


6.  Did  you  experience  any  problems  during  the  voice  verification  process?  (Cir  cle  one)  YES  NO 

If  so,  please  provide  detail  in  box,  to  include  date  and  time  of  call.  For  additional  space,  please  use  back  of  sheet. 


7.  Would  you  be  willing  to  use  voice  biometrics  to  confirm  identity  in  support  of  military  operations?  (Circle  one) 

a.  strongly  in  favor 

b.  moderately  in  favor 

c.  no  opinion 

d.  moderately  opposed 

e.  strongly  opposed 
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APPENDIX  C.  NPS  SPEAKER  VERIFICATION  CALL  LOG 

SUMMARY 


Groupld 

nbVerifi  cations 

nbAuthentications 

total  calls 

last  call  date 

1 

$1111111111$ 

5 

0 

5 

24-Apr-05 

2 

$1122334455$ 

4 

1 

5 

6-May-05 

3 

$1234567899$ 

20 

0 

20 

24-Apr-05 

4 

$2083789591$ 

12 

0 

12 

5-May-05 

5 

$2084091877$ 

1 

0 

1 

24-Apr-05 

6 

$2085626301$ 

9 

1 

10 

8-May-05 

7 

$2088468779$ 

2 

0 

2 

5-May-05 

8 

$2088711181$ 

2 

0 

2 

22-Apr-05 

9 

$2814658756$ 

9 

2 

11 

5-May-05 

10 

$2815433846$ 

11 

0 

11 

5-May-05 

11 

$2817020380$ 

8 

0 

8 

4-May-05 

12 

$3615334051$ 

4 

0 

4 

8-May-05 

13 

$4046643228$ 

4 

0 

4 

20-Apr-05 

14 

$4048088321$ 

9 

0 

9 

8-May-05 

15 

$4105622615$ 

1 

0 

1 

20-Apr-05 

16 

$4128492799$ 

2 

0 

2 

8-May-05 

17 

$4129512235$ 

0 

1 

1 

8-May-05 

18 

$4129512236$ 

6 

0 

6 

8-May-05 

19 

$4436109744$ 

1 

0 

1 

20-Apr-05 

20 

$5138994280$ 

10 

0 

10 

4-May-05 

21 

$5384276532$ 

4 

0 

4 

4-May-05 

22 

$5712511799$ 

6 

1 

7 

8-May-05 

23 

$6194597270$ 

9 

0 

9 

4-May-05 

24 

$6384276532$ 

1 

0 

1 

7-May-05 

25 

$6385276532$ 

0 

1 

1 

7-May-05 

26 

$7032723578$ 

1 

0 

1 

2-May-05 

27 

$7142067685$ 

34 

0 

34 

8-May-05 

28 

$7243273272$ 

5 

0 

5 

6-May-05 

29 

$7243277727$ 

6 

0 

6 

23-Apr-05 

30 

$7247332939$ 

6 

0 

6 

23-Apr-05 

31 

$7819812682$ 

16 

0 

16 

7-May-05 

32 

$7819812703$ 

4 

0 

4 

22-Apr-05 

33 

$7819814494$ 

1 

0 

1 

21 -Apr-05 

34 

$8032613610$ 

4 

1 

5 

24-Apr-05 

35 

$8058787934$ 

2 

0 

2 

6-May-05 

36 

$8084733222$ 

3 

0 

3 

22-Apr-05 

37 

$8312102949$ 

3 

0 

3 

20-Apr-05 
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Groupld 

nbVerifi  cations 

nbAuthentications 

total  calls 

last  call  date 

38 

$8312103096$ 

1 

0 

1 

20-Apr-05 

39 

$8312244317$ 

12 

0 

12 

8-May-05 

40 

$8312746454$ 

9 

0 

9 

8-May-05 

41 

$8312746474$ 

3 

2 

5 

8-May-05 

42 

$8312771404$ 

3 

0 

3 

6-May-05 

43 

$8312953880$ 

7 

0 

7 

7-May-05 

44 

$8313331562$ 

9 

1 

10 

4-May-05 

45 

$8313339467$ 

7 

0 

7 

4-May-05 

46 

$8314021584$ 

5 

0 

5 

23-Apr-05 

47 

$8314436128$ 

10 

0 

10 

7-May-05 

48 

$8314793542$ 

2 

0 

2 

23-Apr-05 

49 

$8316449484$ 

11 

0 

11 

8-May-05 

50 

$8316465922$ 

1 

0 

1 

22-Apr-05 

51 

$8316492592$ 

5 

0 

5 

23-Apr-05 

52 

$8316551833$ 

9 

0 

9 

8-May-05 

53 

$8316561006$ 

4 

0 

4 

6-May-05 

54 

$8316561905$ 

1 

0 

1 

24-Apr-05 

55 

$8316563837$ 

8 

0 

8 

21 -Apr-05 

56 

$8318404507$ 

5 

0 

5 

23-Apr-05 

57 

$8318404508$ 

5 

0 

5 

6-May-05 

58 

$8318690006$ 

1 

0 

1 

20-Apr-05 

59 

$8318690365$ 

0 

2 

2 

8-May-05 

60 

$8318691356$ 

4 

0 

4 

20-Apr-05 

61 

$8318699638$ 

41 

0 

41 

6-May-05 

62 

$8318840849$ 

1 

0 

1 

21 -Apr-05 

63 

$8319159995$ 

1 

0 

1 

6-May-05 

64 

$8319172699$ 

6 

0 

6 

3-May-05 

65 

$8325850031$ 

5 

0 

5 

20-Apr-05 

66 

$9042372253$ 

1 

0 

1 

20-Apr-05 

67 

$9167059780$ 

1 

0 

1 

21 -Apr-05 

68 

$9287654321$ 

0 

1 

1 

22-Apr-05 

69 

$9876543210$ 

8 

0 

8 

5-May-05 

70 

$9988776655$ 

5 

0 

5 

22-Apr-05 
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APPENDIX  D.  NPS  SPEAKER  VERIFICATION  REJECTED 

CALL  SUMMARY 


True  Failures  (False  Rejections)(12  attempts) 


User  ID 

Time  Stamp 

Remarks 

$123456789952734 

4/20/2005  17:39 

True  Failure 

$5712511799$ 

5/7/2005  12:38 

True  Failure 

$7142067685$ 

5/4/2005  9:48 

True  Failure 

$7142067685$ 

5/5/2005  9:57 

True  Failure 

$7142067685$ 

5/5/2005  18:15 

True  Failure 

$714206768581123 

4/23/2005  12:16 

True  Failure 

$781981268251111 

4/20/2005  22:40 

True  Failure 

S7819812682S1 1 1 1 

4/20/2005  22:32 

True  Failure 

$781981268281111 

4/20/2005  22:35 

True  Failure 

S7819812682S1 111 

4/21/2005  10:24 

True  Failure 

$8312244317$ 

5/8/2005  10:49 

True  Failure 

$8312953880$ 1 234 

4/23/2005  7:46 

True  Failure 

Incomplete  Data  (13  attempts) 


User  ID 

Time  Stamp 

Remarks 

$123456789982734 

4/20/2005  17:40 

Utterance  3  is  empty 

$2814658756$ 

5/5/2005  18:55 

Hung  up.  Man  enrolled.  Female  started  the  process 

$2814658756$ 

0455:46  PM 

Hung  up.  Man  enrolled.  Female  and  male  voice  mix  up 

$2815433846$ 

5/5/2005  19:00 

Incomplete  data.  Tried  to  fool  the  system  by  saying  numbers  in 
Spanish.  Did  give  only  one  utterance 

$4048088321$ 

5/8/2005  9:20 

Did  not  complete  the  numbers.  Only  uttered  up  to  4  or  5 

$714206768581123 

4/21/2005  7:26 

Many  utterances  are  empty 

$714206768581123 

4/22/2005  9:39 

Third  utterance  was  inaudible 

$8316561006$ 

4/24/2005  12:48 

Incomplete  data. 

$8316563837$ 

4/21/2005  10:36 

Hung  up.  Did  not  utter  1-2-3- 

$8318404508$ 

4/20/2005  14:42 

Did  not  utter  1-2-3  at  all 

$8318690365$ 

5/7/2005  16:29 

Not  previously  enrolled 

$8318690365$ 

5/8/2005  11:14 

Not  previously  enrolled 

$83192712699$ 

4/23/2005  22:01 

Did  not  utter  1-2-3  at  all 
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Correct  Rejections  (10  attempts) 


User  ID 

Time  Stamp 

Remarks 

S1234567899S2734 

4/20/2005  17:39 

Sam  was  trying  to  break  into  Jim's  account 

S1234567899S2734 

4/20/2005  17:40 

Sam  was  trying  to  break  into  Jim's  account 

S1234567899S2734 

4/22/2005  13:54 

Jim  was  holding  his  nose  tight  not  normal 

S5138994280S 

5/4/2005  17:29 

Imposter  attempt  thwarted.  Female  original  male 
imposter 

S8316561006S 

5/5/2005  18:34:20  PM 

This  was  an  attempt  to  break  into  the  system 

S8316561006S 

5/6/2005  17:27:18  PM 

This  was  an  attempt  to  break  into  the  system 

$8316561006$ 

5/6/2005  17:29:08  PM 

This  was  an  attempt  to  break  into  the  system 

S8316561905S1972 

4/24/2005  13:41 

This  was  an  attempt  to  break  into  the  system 

S83 18691356S 

4/20/2005  17:45 

This  was  an  attempt  to  break  into  the  system 

$83 1869963 8$ 1234 

4/20/2005  17:43 

Imposter  Attempt  Failed 

False  Acceptances  (5  attempts) 


User  ID 

Time  Stamp 

Remarks 

$4046643228$ 

4/20/2005  17:32 

Imposter  attempt  system  failed 

$4046643228$ 

4/20/2005  5:37 

Imposter  attempt  system  did  not  detect 

S4046643228S 

4/20/2005  5:44 

Imposter  attempt  system  did  not  detect 

$8316561006$ 

5/5/2005  18:31:51  PM 

Imposter  attempt  system  failed 

$8318691356$ 

4/20/2005  0:34 

Imposter  attempt  system  did  not  detect 

Failure  to  Enroll  (12  attempts) 


User  ID 

Time  Stamp 

Remarks 

$1122334455$ 

4/22/2005  12:11 

Failed  to  enroll 

$2085626301$ 

5/3/2005  18:51 

Failed  to  enroll 

S4129512235S 

5/8/2005  10:21 

Failed  to  enroll.  Hung  up 

$5712511799$ 

4/22/2005  20:27 

Failed  to  enroll 

$6385277653$ 

5/7/2005  9:18 

Failed  to  enroll.  Hung  up 

$8032613601$ 

4/23/2005  13:05 

Failed  to  enroll 

$8032613601$ 

4/23/2005  13:10 

Failed  to  enroll 

$8084733222$ 

Failed  to  enroll 

$8312746474$ 

5/4/2005  9:03 

Failed  to  enroll.  Hung  up 

$8312746474$ 

5/4/2005  9:05 

Failed  to  enroll.  Hung  up 

$8313331562$ 

5/4/2005  12:36 

Failed  to  enroll.  Hung  up 

$9287654321$ 

4/22/2005  19:47 

Failure  to  enroll 
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APPENDIX  E.  NUANCE  ANALYSIS  SUMMARY 


ChnrJpc  JnrkowKki 

Director,  Speech  Technology,  Professional  Services 


Naval  Postgraduate  School 
Verification  Test  Report 


NUANCE 


>  Overview 

>  Basic  Statistics 

>  Analysis  Methodology 

>  Analysis 

>  Summary 
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Overview 


>  Deployed  Instance  of  Nuance  Caller  Authentication 

•  Packaged  solution  tor  speaker  vet  filiation 
.  3  axampiw  of  I -9  tor  Ervolimam 

•  1  or  2  examples  of  i-fl  for  Verincalion 

-  In  the  tied,  80S  of  ts  lers  would  need  only  1  cxaTple 

•  No  knowledge  verticaion 

-  PIN  secret  dale 

*  Conducted  Verification  Teat 

■  Vanatxe-Kmgfn-vanficason  o* 

-  | Almost)  a  I  speakers  experienced  2  verification  utterances 

•  No  speaker  adaptation 

>  Goal-  Present  speaker  verification  results 

•  Basic  statutes 

•  False  Accept/False  Reject  rates 


Basic  Statistics 


>  Enrollments 

>  Verifications 

>  Rejected  calls 

>  Two  data  collection  phases 

•  Phase  I  -  Late  April 

•  Phase  II  -  Early  May 


llklwv 
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Basic  Statistics  -  Enrollments 


>71  Total  Enrollments 
•  17  in  Phase  II 


////////////////SS//S//S 


Basic  Statistics  -  Verifications 


>411  Total  Verification  Attempts 

•  204  in  Phase  I 

♦  ?07  in  Phase  II 
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Basic  Statistics  -  Verifications 


>  Number  of  attempts  by  user 


Basic  Statistics  -  Rejected  Calls 


>  46/41 1  =111%  Rejected  True  Speaker  Attempts 

•  24/204  =  1 1  8%  In  Phase  I 

•  22/207  ■  10  6%  in  Phase  II 

>  Not  all  were  false  rejects 

»  7  identified  as  correct  rejects'  by  listening 
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Analysis  Methodology 


>  Get  raw  data  from  application 

>  Generate  First  pass  at  basic  statistics 

>  Listen  to  rejects 

•  Ertr6llm*rtt  *rtd  vdnfieiltdrt  sessions 

•  Identify  'correct  rejects' 

>  Generate  second  pass  at  statistics 

•  Incorporate  correct  rejects 

>  Run  batchrec  with  off-line  impostor  tnals 

•  Result  ROC  curve 

•  FA/FR  tradeoff 


Analysis  Methodology 


>  False  Reject  Rate 

•  Verification  Attempts 

•  Correct  rejects  inserted  by  listening 

•  411  attempts 

>  False  Accept  Rate 

•  Off-line 

•  EucM  wiifiewtiori  kukiuuii  tun  siuuinsl  nil  utliur  voicvpriritK 

•  -4300  emulated  impoator  attempt* 
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Analysis 


>  Identified  7  'correct  rejects' 
•  C  xampies 


Enrollment 

Verification 

different  Speaker 

4 

4 

Different  Speaker 

4 

4 

Playing"  with 
system 

4 

Analysis 


>  Identified  3  model  pairs  enrolled  by  the  same 
speaker 

•  $5384276532591 20  and  $638427653259121 

•  $831402158451111  and  S8316563837S11 11 

•  54126492799S2480  and  $112233445550282 

>  During  off-line  impostor  simulation,  those  pairs 
not  used 
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Analysis 


>  ROC  curve 

•  Cqusl  Crror  Rate 
30% 

•  Can  achieve  lower 
FR  with  lower 
threshold 


•OCcww 


•  II  I  II  I  II  ■  U  I  II  « 


Analysis 


>  Comparison  with 
expected 
performance 

■  Wither  range  o t 
expectations  from 
other  data  sets 
•  Other  data 
EER-34% 
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Analysis 


>  Phase  I/Phase  II 


HOC  lint 


•  PhawelEER  2  5% 

•  Phoie  II  EER  3  4% 

•  SligM  reduction  m 
performance  between 
•eewiona 

•  SMI  well  wittm 
expected 
performance 

•  Actual  application 
would  us*  adaptation 

-  25%  reduction  in 
FR  FA*1% 
after  3  can,  35% 
after  6  caie. 


Analysis 


>  Speakers  with 
multiple 
enrollments 

•  Effect  of  removing 

•  Same  EER 

•  More  difference  at 

lew  fa 
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Analysis 


>  Remove  top  2  most 
frequent  speakers 

•  for  ie%  Of 
verification  at  tempi* 

•  Do  not  want  to  overty 
•k*W  nMl 

>  Result 

•  No  significant  change  in 
performance 

•  Mosl  frequent  speakers 
not  skewing 
performance 


Other  Studies 


>  University  of  Edinburgh 

•  1  2%  Half  Total  Error  Rate  (HTER) 

-  (FA  ♦  FRV2 

•  At  FA=1%.  current  application  performing  at  2  7% 

-  Lower  tnan  3%  EER  reported  HTER<EER 

•  More  data  for  enrollment  and  verification  than  with  current 
trial 

-  Multiple  phrases 

>  IBG 

•  0  8%  FAR/1  0%  FRR  for  landlmc 

•  Comptetely  matched  handsets 

•  More  data 

-  3*  16  digits  for  both  enrollment  and  verification 
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Summary 


>  Verification  Performance  excellent 

>  Well  within  expected  ranges 

>  Slight  decrease  between  phases,  would  be 
(more  than)  addressed  using  adaptation 

>  Performance  not  skewed  by  most  frequent 
speakers 


Charles  Jankowski 
clmrlp»J®tiuancr  com 


www.nuance.com 


Tk*  Nam  Vein  «/  Buunrn 
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